2023-07-16 06:10:50,946 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 06:10:51,197 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb 2023-07-16 06:10:51,198 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-16 06:10:51,244 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 06:10:51,506 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 06:10:51,507 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f, deleteOnExit=true 2023-07-16 06:10:51,507 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 06:10:51,507 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/test.cache.data in system properties and HBase conf 2023-07-16 06:10:51,508 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 06:10:51,508 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop.log.dir in system properties and HBase conf 2023-07-16 06:10:51,509 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 06:10:51,509 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 06:10:51,509 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 06:10:51,893 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 06:10:51,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:10:51,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:10:51,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 06:10:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:10:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 06:10:51,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 06:10:51,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:10:51,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:10:51,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 06:10:51,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/nfs.dump.dir in system properties and HBase conf 2023-07-16 06:10:51,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir in system properties and HBase conf 2023-07-16 06:10:51,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:10:51,905 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 06:10:51,905 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 06:10:52,518 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 06:10:52,522 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 06:10:52,806 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 06:10:52,991 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 06:10:53,005 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:53,041 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:53,073 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_localhost_45169_hdfs____l3t7p9/webapp 2023-07-16 06:10:53,231 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45169 2023-07-16 06:10:53,268 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 06:10:53,268 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 06:10:53,842 WARN [Listener at localhost/33329] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:53,931 WARN [Listener at localhost/33329] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:53,950 WARN [Listener at localhost/33329] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:53,956 INFO [Listener at localhost/33329] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:53,962 INFO [Listener at localhost/33329] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_localhost_42259_datanode____vo6xa7/webapp 2023-07-16 06:10:54,084 INFO [Listener at localhost/33329] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42259 2023-07-16 06:10:54,601 WARN [Listener at localhost/45621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:54,648 WARN [Listener at localhost/45621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:54,652 WARN [Listener at localhost/45621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:54,654 INFO [Listener at localhost/45621] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:54,663 INFO [Listener at localhost/45621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_localhost_43461_datanode____wiprlj/webapp 2023-07-16 06:10:54,794 INFO [Listener at localhost/45621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43461 2023-07-16 06:10:54,813 WARN [Listener at localhost/46833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:54,852 WARN [Listener at localhost/46833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:54,858 WARN [Listener at localhost/46833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:54,860 INFO [Listener at localhost/46833] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:54,868 INFO [Listener at localhost/46833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_localhost_46711_datanode____.i9qbic/webapp 2023-07-16 06:10:55,024 INFO [Listener at localhost/46833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46711 2023-07-16 06:10:55,060 WARN [Listener at localhost/41857] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:55,430 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9ee6929ab41dc8f: Processing first storage report for DS-70179a84-fbcd-424d-ae23-98dd2af9a228 from datanode 3ba8bffb-889c-44cc-928a-365b4e139aef 2023-07-16 06:10:55,432 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9ee6929ab41dc8f: from storage DS-70179a84-fbcd-424d-ae23-98dd2af9a228 node DatanodeRegistration(127.0.0.1:37737, datanodeUuid=3ba8bffb-889c-44cc-928a-365b4e139aef, infoPort=41217, infoSecurePort=0, ipcPort=46833, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,432 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9147187c55184496: Processing first storage report for DS-58504d5f-cf54-4e9e-9027-14fb1255b178 from datanode 333a58b0-bd8a-436d-a484-a63f8d35a241 2023-07-16 06:10:55,432 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9147187c55184496: from storage DS-58504d5f-cf54-4e9e-9027-14fb1255b178 node DatanodeRegistration(127.0.0.1:43009, datanodeUuid=333a58b0-bd8a-436d-a484-a63f8d35a241, infoPort=43091, infoSecurePort=0, ipcPort=45621, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,432 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b0bd3dd6603337: Processing first storage report for DS-704ba302-958e-465a-952c-c871239403c2 from datanode 929da384-5eae-4a42-861b-d394d06fea71 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b0bd3dd6603337: from storage DS-704ba302-958e-465a-952c-c871239403c2 node DatanodeRegistration(127.0.0.1:34405, datanodeUuid=929da384-5eae-4a42-861b-d394d06fea71, infoPort=35647, infoSecurePort=0, ipcPort=41857, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9ee6929ab41dc8f: Processing first storage report for DS-b534ce9b-1ba9-4bb7-98a4-da09be09e3cd from datanode 3ba8bffb-889c-44cc-928a-365b4e139aef 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9ee6929ab41dc8f: from storage DS-b534ce9b-1ba9-4bb7-98a4-da09be09e3cd node DatanodeRegistration(127.0.0.1:37737, datanodeUuid=3ba8bffb-889c-44cc-928a-365b4e139aef, infoPort=41217, infoSecurePort=0, ipcPort=46833, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9147187c55184496: Processing first storage report for DS-bc905e0d-30c4-4a67-b4bd-8ead12fab424 from datanode 333a58b0-bd8a-436d-a484-a63f8d35a241 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9147187c55184496: from storage DS-bc905e0d-30c4-4a67-b4bd-8ead12fab424 node DatanodeRegistration(127.0.0.1:43009, datanodeUuid=333a58b0-bd8a-436d-a484-a63f8d35a241, infoPort=43091, infoSecurePort=0, ipcPort=45621, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b0bd3dd6603337: Processing first storage report for DS-7a161edf-895f-4884-9165-e1aad3124d40 from datanode 929da384-5eae-4a42-861b-d394d06fea71 2023-07-16 06:10:55,433 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b0bd3dd6603337: from storage DS-7a161edf-895f-4884-9165-e1aad3124d40 node DatanodeRegistration(127.0.0.1:34405, datanodeUuid=929da384-5eae-4a42-861b-d394d06fea71, infoPort=35647, infoSecurePort=0, ipcPort=41857, storageInfo=lv=-57;cid=testClusterID;nsid=1192794488;c=1689487852597), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,650 DEBUG [Listener at localhost/41857] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb 2023-07-16 06:10:55,743 INFO [Listener at localhost/41857] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/zookeeper_0, clientPort=56819, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 06:10:55,760 INFO [Listener at localhost/41857] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56819 2023-07-16 06:10:55,772 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:55,775 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:56,447 INFO [Listener at localhost/41857] util.FSUtils(471): Created version file at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c with version=8 2023-07-16 06:10:56,448 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/hbase-staging 2023-07-16 06:10:56,844 INFO [Listener at localhost/41857] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 06:10:57,522 INFO [Listener at localhost/41857] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:57,563 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,563 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,564 INFO [Listener at localhost/41857] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:57,564 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,564 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:57,724 INFO [Listener at localhost/41857] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:57,810 DEBUG [Listener at localhost/41857] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 06:10:57,914 INFO [Listener at localhost/41857] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39159 2023-07-16 06:10:57,928 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:57,930 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:57,952 INFO [Listener at localhost/41857] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39159 connecting to ZooKeeper ensemble=127.0.0.1:56819 2023-07-16 06:10:58,004 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:391590x0, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39159-0x1016cc1536e0000 connected 2023-07-16 06:10:58,041 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,041 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,062 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,074 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39159 2023-07-16 06:10:58,074 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39159 2023-07-16 06:10:58,077 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39159 2023-07-16 06:10:58,083 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39159 2023-07-16 06:10:58,086 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39159 2023-07-16 06:10:58,094 INFO [Listener at localhost/41857] master.HMaster(444): hbase.rootdir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, hbase.cluster.distributed=false 2023-07-16 06:10:58,173 INFO [Listener at localhost/41857] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,174 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,174 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,174 INFO [Listener at localhost/41857] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,174 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,174 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,180 INFO [Listener at localhost/41857] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,187 INFO [Listener at localhost/41857] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43885 2023-07-16 06:10:58,191 INFO [Listener at localhost/41857] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,200 DEBUG [Listener at localhost/41857] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 06:10:58,202 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,204 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,207 INFO [Listener at localhost/41857] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43885 connecting to ZooKeeper ensemble=127.0.0.1:56819 2023-07-16 06:10:58,214 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:438850x0, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,215 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:438850x0, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43885-0x1016cc1536e0001 connected 2023-07-16 06:10:58,217 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,218 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,222 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43885 2023-07-16 06:10:58,223 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43885 2023-07-16 06:10:58,227 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43885 2023-07-16 06:10:58,228 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43885 2023-07-16 06:10:58,229 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43885 2023-07-16 06:10:58,247 INFO [Listener at localhost/41857] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,248 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,248 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,248 INFO [Listener at localhost/41857] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,249 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,249 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,249 INFO [Listener at localhost/41857] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,252 INFO [Listener at localhost/41857] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33137 2023-07-16 06:10:58,252 INFO [Listener at localhost/41857] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,258 DEBUG [Listener at localhost/41857] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 06:10:58,259 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,262 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,265 INFO [Listener at localhost/41857] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33137 connecting to ZooKeeper ensemble=127.0.0.1:56819 2023-07-16 06:10:58,271 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:331370x0, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,273 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:331370x0, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,274 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:331370x0, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33137-0x1016cc1536e0002 connected 2023-07-16 06:10:58,275 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,276 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33137 2023-07-16 06:10:58,277 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33137 2023-07-16 06:10:58,282 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33137 2023-07-16 06:10:58,288 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33137 2023-07-16 06:10:58,290 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33137 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,305 INFO [Listener at localhost/41857] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,306 INFO [Listener at localhost/41857] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,308 INFO [Listener at localhost/41857] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39467 2023-07-16 06:10:58,309 INFO [Listener at localhost/41857] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,318 DEBUG [Listener at localhost/41857] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 06:10:58,319 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,321 INFO [Listener at localhost/41857] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,322 INFO [Listener at localhost/41857] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39467 connecting to ZooKeeper ensemble=127.0.0.1:56819 2023-07-16 06:10:58,326 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:394670x0, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,327 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:394670x0, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39467-0x1016cc1536e0003 connected 2023-07-16 06:10:58,335 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,336 DEBUG [Listener at localhost/41857] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,350 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39467 2023-07-16 06:10:58,352 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39467 2023-07-16 06:10:58,354 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39467 2023-07-16 06:10:58,363 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39467 2023-07-16 06:10:58,369 DEBUG [Listener at localhost/41857] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39467 2023-07-16 06:10:58,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:58,390 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 06:10:58,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:58,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:58,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 06:10:58,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39159,1689487856639 from backup master directory 2023-07-16 06:10:58,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 06:10:58,442 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:58,442 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 06:10:58,443 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:10:58,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:58,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 06:10:58,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 06:10:58,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/hbase.id with ID: 08b7084a-75b2-4047-bc81-600974125662 2023-07-16 06:10:58,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,637 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:58,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2b6ede4d to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:58,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e429a01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:58,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:10:58,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 06:10:58,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 06:10:58,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 06:10:58,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:58,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:58,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:10:58,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store-tmp 2023-07-16 06:10:58,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:10:58,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 06:10:58,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 06:10:58,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:10:58,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/WALs/jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:58,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39159%2C1689487856639, suffix=, logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/WALs/jenkins-hbase4.apache.org,39159,1689487856639, archiveDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/oldWALs, maxLogs=10 2023-07-16 06:10:59,025 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK] 2023-07-16 06:10:59,027 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK] 2023-07-16 06:10:59,027 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK] 2023-07-16 06:10:59,043 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:59,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/WALs/jenkins-hbase4.apache.org,39159,1689487856639/jenkins-hbase4.apache.org%2C39159%2C1689487856639.1689487858952 2023-07-16 06:10:59,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK], DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK], DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK]] 2023-07-16 06:10:59,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:10:59,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:10:59,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,232 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,241 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 06:10:59,282 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 06:10:59,298 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:10:59,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:10:59,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67300028, jitterRate=0.0028485655784606934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:10:59,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:10:59,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 06:10:59,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 06:10:59,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 06:10:59,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 06:10:59,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 06:10:59,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-16 06:10:59,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 06:10:59,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 06:10:59,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 06:10:59,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 06:10:59,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 06:10:59,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 06:10:59,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 06:10:59,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 06:10:59,523 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 06:10:59,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 06:10:59,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 06:10:59,570 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,570 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,570 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,570 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,570 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39159,1689487856639, sessionid=0x1016cc1536e0000, setting cluster-up flag (Was=false) 2023-07-16 06:10:59,599 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 06:10:59,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:59,624 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 06:10:59,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:10:59,638 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp 2023-07-16 06:10:59,685 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(951): ClusterId : 08b7084a-75b2-4047-bc81-600974125662 2023-07-16 06:10:59,700 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(951): ClusterId : 08b7084a-75b2-4047-bc81-600974125662 2023-07-16 06:10:59,696 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(951): ClusterId : 08b7084a-75b2-4047-bc81-600974125662 2023-07-16 06:10:59,710 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,711 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,710 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,720 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,720 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,721 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,721 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,720 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,721 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,732 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,732 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,734 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,734 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ReadOnlyZKClient(139): Connect 0x683b2496 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,740 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ReadOnlyZKClient(139): Connect 0x35b2d272 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,734 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ReadOnlyZKClient(139): Connect 0x7077879b to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,771 DEBUG [RS:0;jenkins-hbase4:43885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31255c6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,772 DEBUG [RS:1;jenkins-hbase4:33137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d7e790b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,772 DEBUG [RS:2;jenkins-hbase4:39467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66fcc7e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,772 DEBUG [RS:1;jenkins-hbase4:33137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@191bff67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,772 DEBUG [RS:0;jenkins-hbase4:43885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65716216, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,772 DEBUG [RS:2;jenkins-hbase4:39467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c34fe6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 06:10:59,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 06:10:59,795 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33137 2023-07-16 06:10:59,796 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43885 2023-07-16 06:10:59,799 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39467 2023-07-16 06:10:59,802 INFO [RS:1;jenkins-hbase4:33137] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,802 INFO [RS:1;jenkins-hbase4:33137] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,802 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,803 INFO [RS:1;jenkins-hbase4:33137] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,807 INFO [RS:2;jenkins-hbase4:39467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,808 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,808 INFO [RS:2;jenkins-hbase4:39467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,808 INFO [RS:0;jenkins-hbase4:43885] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,809 INFO [RS:0;jenkins-hbase4:43885] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,808 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,809 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,809 INFO [RS:2;jenkins-hbase4:39467] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,809 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,809 INFO [RS:0;jenkins-hbase4:43885] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,809 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,812 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:33137, startcode=1689487858246 2023-07-16 06:10:59,812 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:39467, startcode=1689487858304 2023-07-16 06:10:59,814 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:43885, startcode=1689487858173 2023-07-16 06:10:59,834 DEBUG [RS:0;jenkins-hbase4:43885] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,834 DEBUG [RS:1;jenkins-hbase4:33137] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,834 DEBUG [RS:2;jenkins-hbase4:39467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 06:10:59,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:10:59,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:10:59,942 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48447, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,942 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37019, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,942 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35091, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689487889981 2023-07-16 06:10:59,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 06:10:59,985 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:10:59,994 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 06:10:59,995 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 06:10:59,998 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:10:59,999 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:11:00,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 06:11:00,003 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:00,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 06:11:00,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 06:11:00,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 06:11:00,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 06:11:00,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 06:11:00,027 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:11:00,028 WARN [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:11:00,029 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:11:00,029 WARN [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:11:00,029 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:11:00,029 WARN [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:11:00,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 06:11:00,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 06:11:00,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 06:11:00,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 06:11:00,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487860046,5,FailOnTimeoutGroup] 2023-07-16 06:11:00,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487860050,5,FailOnTimeoutGroup] 2023-07-16 06:11:00,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 06:11:00,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,108 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:00,110 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:00,110 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:00,129 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:43885, startcode=1689487858173 2023-07-16 06:11:00,130 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:39467, startcode=1689487858304 2023-07-16 06:11:00,137 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39159,1689487856639 with isa=jenkins-hbase4.apache.org/172.31.14.131:33137, startcode=1689487858246 2023-07-16 06:11:00,151 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,161 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39159] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,161 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:00,161 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33329 2023-07-16 06:11:00,161 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,162 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:00,163 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33329 2023-07-16 06:11:00,163 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,164 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:00,164 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33329 2023-07-16 06:11:00,164 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,173 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:11:00,174 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ZKUtil(162): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,174 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ZKUtil(162): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,174 WARN [RS:2;jenkins-hbase4:39467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,175 INFO [RS:2;jenkins-hbase4:39467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,175 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,175 WARN [RS:1;jenkins-hbase4:33137] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,178 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ZKUtil(162): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,178 WARN [RS:0;jenkins-hbase4:43885] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,177 INFO [RS:1;jenkins-hbase4:33137] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,178 INFO [RS:0;jenkins-hbase4:43885] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,179 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,179 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43885,1689487858173] 2023-07-16 06:11:00,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39467,1689487858304] 2023-07-16 06:11:00,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33137,1689487858246] 2023-07-16 06:11:00,226 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ZKUtil(162): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,226 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ZKUtil(162): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,230 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ZKUtil(162): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,231 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ZKUtil(162): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,231 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ZKUtil(162): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,232 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ZKUtil(162): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,232 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ZKUtil(162): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,232 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ZKUtil(162): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,233 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ZKUtil(162): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,234 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:00,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 06:11:00,246 DEBUG [RS:2;jenkins-hbase4:39467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,247 DEBUG [RS:0;jenkins-hbase4:43885] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,247 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,250 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,251 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 06:11:00,252 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 06:11:00,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 06:11:00,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 06:11:00,269 INFO [RS:1;jenkins-hbase4:33137] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,269 INFO [RS:0;jenkins-hbase4:43885] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,276 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 06:11:00,278 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,270 INFO [RS:2;jenkins-hbase4:39467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,282 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740 2023-07-16 06:11:00,284 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740 2023-07-16 06:11:00,289 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 06:11:00,291 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 06:11:00,300 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:00,301 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73823694, jitterRate=0.10005876421928406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 06:11:00,301 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 06:11:00,301 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 06:11:00,301 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 06:11:00,301 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 06:11:00,302 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 06:11:00,302 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 06:11:00,326 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 06:11:00,326 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 06:11:00,334 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 06:11:00,334 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 06:11:00,343 INFO [RS:1;jenkins-hbase4:33137] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,345 INFO [RS:2;jenkins-hbase4:39467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,345 INFO [RS:0;jenkins-hbase4:43885] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,350 INFO [RS:1;jenkins-hbase4:33137] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,350 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 06:11:00,351 INFO [RS:0;jenkins-hbase4:43885] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,352 INFO [RS:2;jenkins-hbase4:39467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,352 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,352 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,355 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,355 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,355 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,365 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,365 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,365 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,365 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,365 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,366 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,367 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:0;jenkins-hbase4:43885] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,367 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,368 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,368 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,368 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,368 DEBUG [RS:1;jenkins-hbase4:33137] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,368 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,371 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,371 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,371 DEBUG [RS:2;jenkins-hbase4:39467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,374 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,375 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,375 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,376 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 06:11:00,377 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,380 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 06:11:00,382 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,382 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,383 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,383 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,383 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,396 INFO [RS:0;jenkins-hbase4:43885] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,400 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43885,1689487858173-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,403 INFO [RS:1;jenkins-hbase4:33137] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,419 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33137,1689487858246-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,409 INFO [RS:2;jenkins-hbase4:39467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,420 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39467,1689487858304-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,443 INFO [RS:0;jenkins-hbase4:43885] regionserver.Replication(203): jenkins-hbase4.apache.org,43885,1689487858173 started 2023-07-16 06:11:00,443 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43885,1689487858173, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43885, sessionid=0x1016cc1536e0001 2023-07-16 06:11:00,449 INFO [RS:2;jenkins-hbase4:39467] regionserver.Replication(203): jenkins-hbase4.apache.org,39467,1689487858304 started 2023-07-16 06:11:00,449 INFO [RS:1;jenkins-hbase4:33137] regionserver.Replication(203): jenkins-hbase4.apache.org,33137,1689487858246 started 2023-07-16 06:11:00,449 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,449 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33137,1689487858246, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33137, sessionid=0x1016cc1536e0002 2023-07-16 06:11:00,449 DEBUG [RS:0;jenkins-hbase4:43885] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,450 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,449 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39467,1689487858304, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39467, sessionid=0x1016cc1536e0003 2023-07-16 06:11:00,450 DEBUG [RS:1;jenkins-hbase4:33137] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,451 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,450 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43885,1689487858173' 2023-07-16 06:11:00,452 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,451 DEBUG [RS:2;jenkins-hbase4:39467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,452 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39467,1689487858304' 2023-07-16 06:11:00,452 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,451 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33137,1689487858246' 2023-07-16 06:11:00,452 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,453 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,453 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,453 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,453 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,453 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,453 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,454 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,453 DEBUG [RS:0;jenkins-hbase4:43885] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:00,454 DEBUG [RS:2;jenkins-hbase4:39467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:00,454 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39467,1689487858304' 2023-07-16 06:11:00,454 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43885,1689487858173' 2023-07-16 06:11:00,455 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,455 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,455 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,456 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,456 DEBUG [RS:1;jenkins-hbase4:33137] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,456 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33137,1689487858246' 2023-07-16 06:11:00,456 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,456 DEBUG [RS:2;jenkins-hbase4:39467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,456 DEBUG [RS:0;jenkins-hbase4:43885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,457 DEBUG [RS:1;jenkins-hbase4:33137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,457 DEBUG [RS:0;jenkins-hbase4:43885] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,457 DEBUG [RS:2;jenkins-hbase4:39467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,457 INFO [RS:0;jenkins-hbase4:43885] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,457 INFO [RS:2;jenkins-hbase4:39467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,458 DEBUG [RS:1;jenkins-hbase4:33137] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,458 INFO [RS:0;jenkins-hbase4:43885] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,459 INFO [RS:1;jenkins-hbase4:33137] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,458 INFO [RS:2;jenkins-hbase4:39467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,459 INFO [RS:1;jenkins-hbase4:33137] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,535 DEBUG [jenkins-hbase4:39159] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 06:11:00,539 DEBUG [jenkins-hbase4:39159] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:00,546 DEBUG [jenkins-hbase4:39159] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:00,546 DEBUG [jenkins-hbase4:39159] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:00,546 DEBUG [jenkins-hbase4:39159] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:00,546 DEBUG [jenkins-hbase4:39159] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:00,550 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33137,1689487858246, state=OPENING 2023-07-16 06:11:00,564 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 06:11:00,565 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:00,566 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 06:11:00,575 INFO [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33137%2C1689487858246, suffix=, logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,33137,1689487858246, archiveDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs, maxLogs=32 2023-07-16 06:11:00,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:00,575 INFO [RS:0;jenkins-hbase4:43885] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43885%2C1689487858173, suffix=, logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,43885,1689487858173, archiveDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs, maxLogs=32 2023-07-16 06:11:00,579 INFO [RS:2;jenkins-hbase4:39467] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39467%2C1689487858304, suffix=, logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,39467,1689487858304, archiveDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs, maxLogs=32 2023-07-16 06:11:00,602 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK] 2023-07-16 06:11:00,602 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK] 2023-07-16 06:11:00,625 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK] 2023-07-16 06:11:00,631 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK] 2023-07-16 06:11:00,639 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK] 2023-07-16 06:11:00,643 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK] 2023-07-16 06:11:00,643 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK] 2023-07-16 06:11:00,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK] 2023-07-16 06:11:00,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK] 2023-07-16 06:11:00,650 INFO [RS:2;jenkins-hbase4:39467] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,39467,1689487858304/jenkins-hbase4.apache.org%2C39467%2C1689487858304.1689487860580 2023-07-16 06:11:00,659 DEBUG [RS:2;jenkins-hbase4:39467] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK], DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK], DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK]] 2023-07-16 06:11:00,661 INFO [RS:0;jenkins-hbase4:43885] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,43885,1689487858173/jenkins-hbase4.apache.org%2C43885%2C1689487858173.1689487860579 2023-07-16 06:11:00,661 INFO [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,33137,1689487858246/jenkins-hbase4.apache.org%2C33137%2C1689487858246.1689487860579 2023-07-16 06:11:00,662 DEBUG [RS:0;jenkins-hbase4:43885] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK], DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK], DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK]] 2023-07-16 06:11:00,663 DEBUG [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK], DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK], DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK]] 2023-07-16 06:11:00,769 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:00,772 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:00,777 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:00,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 06:11:00,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33137%2C1689487858246.meta, suffix=.meta, logDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,33137,1689487858246, archiveDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs, maxLogs=32 2023-07-16 06:11:00,833 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK] 2023-07-16 06:11:00,835 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK] 2023-07-16 06:11:00,836 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK] 2023-07-16 06:11:00,849 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/WALs/jenkins-hbase4.apache.org,33137,1689487858246/jenkins-hbase4.apache.org%2C33137%2C1689487858246.meta.1689487860808.meta 2023-07-16 06:11:00,850 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43009,DS-58504d5f-cf54-4e9e-9027-14fb1255b178,DISK], DatanodeInfoWithStorage[127.0.0.1:34405,DS-704ba302-958e-465a-952c-c871239403c2,DISK], DatanodeInfoWithStorage[127.0.0.1:37737,DS-70179a84-fbcd-424d-ae23-98dd2af9a228,DISK]] 2023-07-16 06:11:00,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:00,852 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 06:11:00,854 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:00,855 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 06:11:00,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 06:11:00,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 06:11:00,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 06:11:00,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:00,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 06:11:00,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 06:11:00,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 06:11:00,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,886 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 06:11:00,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 06:11:00,890 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,891 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,891 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 06:11:00,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 06:11:00,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,898 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 06:11:00,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740 2023-07-16 06:11:00,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740 2023-07-16 06:11:00,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 06:11:00,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 06:11:00,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62424083, jitterRate=-0.06980867683887482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 06:11:00,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 06:11:00,943 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689487860761 2023-07-16 06:11:00,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 06:11:00,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 06:11:00,962 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33137,1689487858246, state=OPEN 2023-07-16 06:11:00,966 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 06:11:00,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 06:11:00,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 06:11:00,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33137,1689487858246 in 395 msec 2023-07-16 06:11:00,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 06:11:00,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 622 msec 2023-07-16 06:11:00,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1960 sec 2023-07-16 06:11:00,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689487860988, completionTime=-1 2023-07-16 06:11:00,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 06:11:00,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 06:11:01,074 DEBUG [hconnection-0x3ff4576f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:01,080 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:01,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 06:11:01,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689487921108 2023-07-16 06:11:01,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689487981108 2023-07-16 06:11:01,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 119 msec 2023-07-16 06:11:01,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39159,1689487856639-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39159,1689487856639-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39159,1689487856639-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39159, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,154 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 06:11:01,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 06:11:01,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:01,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 06:11:01,181 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:01,185 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:01,216 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,221 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a empty. 2023-07-16 06:11:01,222 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,222 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 06:11:01,282 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:01,286 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d448c541b979f07c15ea41012e66b28a, NAME => 'hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:01,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:01,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d448c541b979f07c15ea41012e66b28a, disabling compactions & flushes 2023-07-16 06:11:01,323 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,323 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,323 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. after waiting 0 ms 2023-07-16 06:11:01,323 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,323 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,323 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d448c541b979f07c15ea41012e66b28a: 2023-07-16 06:11:01,330 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:01,345 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487861333"}]},"ts":"1689487861333"} 2023-07-16 06:11:01,372 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 06:11:01,374 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:01,379 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487861374"}]},"ts":"1689487861374"} 2023-07-16 06:11:01,387 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 06:11:01,391 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:01,392 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:01,392 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:01,392 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:01,392 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:01,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d448c541b979f07c15ea41012e66b28a, ASSIGN}] 2023-07-16 06:11:01,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d448c541b979f07c15ea41012e66b28a, ASSIGN 2023-07-16 06:11:01,400 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d448c541b979f07c15ea41012e66b28a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:11:01,552 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:11:01,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d448c541b979f07c15ea41012e66b28a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:01,554 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487861553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487861553"}]},"ts":"1689487861553"} 2023-07-16 06:11:01,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d448c541b979f07c15ea41012e66b28a, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:01,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d448c541b979f07c15ea41012e66b28a, NAME => 'hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:01,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. service=AccessControlService 2023-07-16 06:11:01,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:01,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:01,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,725 INFO [StoreOpener-d448c541b979f07c15ea41012e66b28a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,728 DEBUG [StoreOpener-d448c541b979f07c15ea41012e66b28a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/info 2023-07-16 06:11:01,728 DEBUG [StoreOpener-d448c541b979f07c15ea41012e66b28a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/info 2023-07-16 06:11:01,729 INFO [StoreOpener-d448c541b979f07c15ea41012e66b28a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d448c541b979f07c15ea41012e66b28a columnFamilyName info 2023-07-16 06:11:01,729 INFO [StoreOpener-d448c541b979f07c15ea41012e66b28a-1] regionserver.HStore(310): Store=d448c541b979f07c15ea41012e66b28a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:01,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d448c541b979f07c15ea41012e66b28a 2023-07-16 06:11:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:01,742 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d448c541b979f07c15ea41012e66b28a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72219064, jitterRate=0.07614791393280029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:01,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d448c541b979f07c15ea41012e66b28a: 2023-07-16 06:11:01,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a., pid=6, masterSystemTime=1689487861712 2023-07-16 06:11:01,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:11:01,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d448c541b979f07c15ea41012e66b28a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:01,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487861752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487861752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487861752"}]},"ts":"1689487861752"} 2023-07-16 06:11:01,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 06:11:01,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d448c541b979f07c15ea41012e66b28a, server=jenkins-hbase4.apache.org,33137,1689487858246 in 197 msec 2023-07-16 06:11:01,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 06:11:01,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d448c541b979f07c15ea41012e66b28a, ASSIGN in 364 msec 2023-07-16 06:11:01,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:01,765 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487861765"}]},"ts":"1689487861765"} 2023-07-16 06:11:01,767 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 06:11:01,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:01,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 605 msec 2023-07-16 06:11:01,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 06:11:01,782 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,782 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:01,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 06:11:01,843 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-07-16 06:11:01,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 06:11:01,881 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-16 06:11:01,897 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 06:11:01,901 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 06:11:01,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.459sec 2023-07-16 06:11:01,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 06:11:01,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 06:11:01,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 06:11:01,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39159,1689487856639-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 06:11:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39159,1689487856639-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 06:11:01,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:01,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 06:11:01,936 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:01,938 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:01,941 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:01,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4 empty. 2023-07-16 06:11:01,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 06:11:01,944 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:01,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 06:11:01,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:01,989 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:01,991 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => de10f23cf2984f34a4891a45eeea0cc4, NAME => 'hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:02,009 DEBUG [Listener at localhost/41857] zookeeper.ReadOnlyZKClient(139): Connect 0x33146fc9 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:02,020 DEBUG [Listener at localhost/41857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9eca1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:02,027 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:02,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing de10f23cf2984f34a4891a45eeea0cc4, disabling compactions & flushes 2023-07-16 06:11:02,029 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. after waiting 0 ms 2023-07-16 06:11:02,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,029 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for de10f23cf2984f34a4891a45eeea0cc4: 2023-07-16 06:11:02,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:02,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487862037"}]},"ts":"1689487862037"} 2023-07-16 06:11:02,040 DEBUG [hconnection-0x72776d24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:02,042 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 06:11:02,044 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:02,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487862044"}]},"ts":"1689487862044"} 2023-07-16 06:11:02,048 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 06:11:02,054 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:02,055 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:02,055 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:02,055 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:02,055 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:02,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=de10f23cf2984f34a4891a45eeea0cc4, ASSIGN}] 2023-07-16 06:11:02,056 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:02,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,060 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=de10f23cf2984f34a4891a45eeea0cc4, ASSIGN 2023-07-16 06:11:02,062 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=de10f23cf2984f34a4891a45eeea0cc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:11:02,070 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:11:02,070 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 06:11:02,070 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/test.cache.data in system properties and HBase conf 2023-07-16 06:11:02,070 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop.log.dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:11:02,071 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/nfs.dump.dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 06:11:02,072 INFO [Listener at localhost/41857] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 06:11:02,212 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:11:02,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=de10f23cf2984f34a4891a45eeea0cc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:02,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487862213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487862213"}]},"ts":"1689487862213"} 2023-07-16 06:11:02,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure de10f23cf2984f34a4891a45eeea0cc4, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:02,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,379 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de10f23cf2984f34a4891a45eeea0cc4, NAME => 'hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:02,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. service=AccessControlService 2023-07-16 06:11:02,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:02,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:02,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,388 INFO [StoreOpener-de10f23cf2984f34a4891a45eeea0cc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,391 DEBUG [StoreOpener-de10f23cf2984f34a4891a45eeea0cc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/l 2023-07-16 06:11:02,391 DEBUG [StoreOpener-de10f23cf2984f34a4891a45eeea0cc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/l 2023-07-16 06:11:02,391 INFO [StoreOpener-de10f23cf2984f34a4891a45eeea0cc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de10f23cf2984f34a4891a45eeea0cc4 columnFamilyName l 2023-07-16 06:11:02,395 INFO [StoreOpener-de10f23cf2984f34a4891a45eeea0cc4-1] regionserver.HStore(310): Store=de10f23cf2984f34a4891a45eeea0cc4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:02,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,406 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:11:02,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:02,427 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de10f23cf2984f34a4891a45eeea0cc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73554259, jitterRate=0.09604386985301971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:02,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de10f23cf2984f34a4891a45eeea0cc4: 2023-07-16 06:11:02,429 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4., pid=11, masterSystemTime=1689487862371 2023-07-16 06:11:02,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,433 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:11:02,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=de10f23cf2984f34a4891a45eeea0cc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:02,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487862435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487862435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487862435"}]},"ts":"1689487862435"} 2023-07-16 06:11:02,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 06:11:02,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure de10f23cf2984f34a4891a45eeea0cc4, server=jenkins-hbase4.apache.org,33137,1689487858246 in 222 msec 2023-07-16 06:11:02,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 06:11:02,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=de10f23cf2984f34a4891a45eeea0cc4, ASSIGN in 397 msec 2023-07-16 06:11:02,467 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:02,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487862467"}]},"ts":"1689487862467"} 2023-07-16 06:11:02,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 06:11:02,477 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:02,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 545 msec 2023-07-16 06:11:02,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 06:11:02,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 06:11:03,434 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:03,721 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:03,728 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44571_jobhistory____.5uewnc/webapp 2023-07-16 06:11:03,907 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 06:11:03,907 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:03,907 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:03,910 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:03,980 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:04,241 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:04,641 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 06:11:04,687 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44571 2023-07-16 06:11:04,932 WARN [Listener at jenkins-hbase4.apache.org/36289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:05,381 WARN [Listener at jenkins-hbase4.apache.org/36289] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:05,382 INFO [Listener at jenkins-hbase4.apache.org/36289] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:05,390 INFO [Listener at jenkins-hbase4.apache.org/36289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42319_cluster____5zh7on/webapp 2023-07-16 06:11:05,484 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:05,484 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 06:11:05,484 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:05,485 INFO [Listener at jenkins-hbase4.apache.org/36289] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:05,500 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:05,786 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:06,101 INFO [Listener at jenkins-hbase4.apache.org/36289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:06,113 INFO [Listener at jenkins-hbase4.apache.org/36289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42319 2023-07-16 06:11:06,593 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:06,807 WARN [Listener at jenkins-hbase4.apache.org/39271] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:06,829 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 06:11:06,830 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 06:11:06,831 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 06:11:06,840 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,841 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 06:11:06,841 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,841 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 06:11:06,842 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 06:11:06,842 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 06:11:06,842 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,842 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 06:11:06,842 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 06:11:06,843 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 06:11:06,847 WARN [Listener at jenkins-hbase4.apache.org/39271] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:06,848 INFO [Listener at jenkins-hbase4.apache.org/39271] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:06,866 INFO [Listener at jenkins-hbase4.apache.org/39271] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35631_node____.dim3io/webapp 2023-07-16 06:11:06,937 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 06:11:06,938 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:06,938 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:06,938 INFO [Listener at jenkins-hbase4.apache.org/39271] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:06,949 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:06,969 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,058 INFO [Listener at jenkins-hbase4.apache.org/39271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,071 INFO [Listener at jenkins-hbase4.apache.org/39271] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35631 2023-07-16 06:11:07,296 WARN [Listener at jenkins-hbase4.apache.org/37817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:07,303 WARN [Listener at jenkins-hbase4.apache.org/37817] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:07,304 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:07,312 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42443_node____.sdd0lp/webapp 2023-07-16 06:11:07,377 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 06:11:07,378 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:07,378 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:07,378 INFO [Listener at jenkins-hbase4.apache.org/37817] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:07,388 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,408 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,508 INFO [Listener at jenkins-hbase4.apache.org/37817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,520 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42443 2023-07-16 06:11:07,547 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 06:11:07,549 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:07,622 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=173, AvailableMemoryMB=4903 2023-07-16 06:11:07,622 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-16 06:11:07,636 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 06:11:07,643 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 06:11:07,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:07,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:07,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:07,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 06:11:07,664 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:07,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:07,669 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:07,669 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:07,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a empty. 2023-07-16 06:11:07,670 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c empty. 2023-07-16 06:11:07,672 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:07,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:07,679 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 06:11:07,726 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:07,729 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5485babd8c89fc2bb69682de5675794a, NAME => 'testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:07,729 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b6878c3942e4404e9af8ed1703cf122c, NAME => 'testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:07,801 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:07,802 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5485babd8c89fc2bb69682de5675794a, disabling compactions & flushes 2023-07-16 06:11:07,802 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:07,802 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:07,802 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. after waiting 0 ms 2023-07-16 06:11:07,802 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:07,802 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:07,802 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5485babd8c89fc2bb69682de5675794a: 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b6878c3942e4404e9af8ed1703cf122c, disabling compactions & flushes 2023-07-16 06:11:07,803 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. after waiting 0 ms 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:07,803 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:07,803 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b6878c3942e4404e9af8ed1703cf122c: 2023-07-16 06:11:07,808 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:07,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487867811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487867811"}]},"ts":"1689487867811"} 2023-07-16 06:11:07,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487867811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487867811"}]},"ts":"1689487867811"} 2023-07-16 06:11:07,864 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:07,866 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:07,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487867866"}]},"ts":"1689487867866"} 2023-07-16 06:11:07,868 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 06:11:07,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:07,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:07,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:07,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:07,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:07,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, ASSIGN}] 2023-07-16 06:11:07,879 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, ASSIGN 2023-07-16 06:11:07,880 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, ASSIGN 2023-07-16 06:11:07,881 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:11:07,882 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43885,1689487858173; forceNewPlan=false, retain=false 2023-07-16 06:11:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,031 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:08,034 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5485babd8c89fc2bb69682de5675794a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,034 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b6878c3942e4404e9af8ed1703cf122c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487868034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487868034"}]},"ts":"1689487868034"} 2023-07-16 06:11:08,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487868034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487868034"}]},"ts":"1689487868034"} 2023-07-16 06:11:08,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5485babd8c89fc2bb69682de5675794a, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:11:08,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure b6878c3942e4404e9af8ed1703cf122c, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:08,192 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,192 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:08,197 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:08,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6878c3942e4404e9af8ed1703cf122c, NAME => 'testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. service=AccessControlService 2023-07-16 06:11:08,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5485babd8c89fc2bb69682de5675794a, NAME => 'testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. service=AccessControlService 2023-07-16 06:11:08,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:08,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:08,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,221 INFO [StoreOpener-5485babd8c89fc2bb69682de5675794a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,226 DEBUG [StoreOpener-5485babd8c89fc2bb69682de5675794a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf 2023-07-16 06:11:08,226 DEBUG [StoreOpener-5485babd8c89fc2bb69682de5675794a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf 2023-07-16 06:11:08,227 INFO [StoreOpener-5485babd8c89fc2bb69682de5675794a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5485babd8c89fc2bb69682de5675794a columnFamilyName cf 2023-07-16 06:11:08,229 INFO [StoreOpener-5485babd8c89fc2bb69682de5675794a-1] regionserver.HStore(310): Store=5485babd8c89fc2bb69682de5675794a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:08,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:08,253 INFO [StoreOpener-b6878c3942e4404e9af8ed1703cf122c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:08,272 DEBUG [StoreOpener-b6878c3942e4404e9af8ed1703cf122c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf 2023-07-16 06:11:08,272 DEBUG [StoreOpener-b6878c3942e4404e9af8ed1703cf122c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf 2023-07-16 06:11:08,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5485babd8c89fc2bb69682de5675794a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73743262, jitterRate=0.0988602340221405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:08,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5485babd8c89fc2bb69682de5675794a: 2023-07-16 06:11:08,273 INFO [StoreOpener-b6878c3942e4404e9af8ed1703cf122c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6878c3942e4404e9af8ed1703cf122c columnFamilyName cf 2023-07-16 06:11:08,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,275 INFO [StoreOpener-b6878c3942e4404e9af8ed1703cf122c-1] regionserver.HStore(310): Store=b6878c3942e4404e9af8ed1703cf122c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:08,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a., pid=15, masterSystemTime=1689487868192 2023-07-16 06:11:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:08,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:08,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5485babd8c89fc2bb69682de5675794a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,293 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487868292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487868292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487868292"}]},"ts":"1689487868292"} 2023-07-16 06:11:08,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-16 06:11:08,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5485babd8c89fc2bb69682de5675794a, server=jenkins-hbase4.apache.org,43885,1689487858173 in 259 msec 2023-07-16 06:11:08,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:08,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, ASSIGN in 426 msec 2023-07-16 06:11:08,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6878c3942e4404e9af8ed1703cf122c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66180997, jitterRate=-0.013826295733451843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:08,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6878c3942e4404e9af8ed1703cf122c: 2023-07-16 06:11:08,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c., pid=16, masterSystemTime=1689487868192 2023-07-16 06:11:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:08,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:08,313 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b6878c3942e4404e9af8ed1703cf122c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,313 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487868313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487868313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487868313"}]},"ts":"1689487868313"} 2023-07-16 06:11:08,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-16 06:11:08,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure b6878c3942e4404e9af8ed1703cf122c, server=jenkins-hbase4.apache.org,33137,1689487858246 in 278 msec 2023-07-16 06:11:08,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-16 06:11:08,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, ASSIGN in 451 msec 2023-07-16 06:11:08,336 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:08,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487868337"}]},"ts":"1689487868337"} 2023-07-16 06:11:08,340 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 06:11:08,343 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:08,349 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 06:11:08,370 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:08,402 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,402 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,402 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,402 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,402 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:08,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 763 msec 2023-07-16 06:11:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,777 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 06:11:08,777 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-16 06:11:08,778 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:08,783 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-16 06:11:08,783 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:08,784 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-16 06:11:08,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:08,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487868799 (current time:1689487868799). 2023-07-16 06:11:08,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:08,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x5358173b to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:08,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39abfd19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:08,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:08,811 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:08,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5358173b to 127.0.0.1:56819 2023-07-16 06:11:08,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:08,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8810ab to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:08,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@321bafed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:08,839 DEBUG [hconnection-0x212acd8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:08,846 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:08,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8810ab to 127.0.0.1:56819 2023-07-16 06:11:08,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:08,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:08,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:08,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:08,906 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:08,908 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689488468908 2023-07-16 06:11:08,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:08,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 06:11:08,912 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:08,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:08,916 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:08,916 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:08,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-16 06:11:08,920 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:08,921 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689488468921 2023-07-16 06:11:08,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,967 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 06:11:08,967 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:08,969 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 06:11:08,969 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 06:11:08,970 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,970 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,974 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:08,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:08,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:08,974 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:08,974 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,975 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,975 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:08,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:08,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:08,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:08,983 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:08,982 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:08,983 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:08,983 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:08,984 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:08,983 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:08,984 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:08,984 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:08,984 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:08,984 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:08,986 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,987 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:08,988 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:08,988 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,988 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:08,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:08,991 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,991 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:08,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:08,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:08,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:08,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:08,995 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 06:11:08,995 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,004 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,004 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,004 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,005 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,005 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:09,006 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,006 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,007 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,007 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:09,007 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:09,009 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. started... 2023-07-16 06:11:09,009 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. started... 2023-07-16 06:11:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,014 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5485babd8c89fc2bb69682de5675794a: 2023-07-16 06:11:09,014 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6878c3942e4404e9af8ed1703cf122c: 2023-07-16 06:11:09,015 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,015 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:09,023 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,023 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,027 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:09,027 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:09,071 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. completed. 2023-07-16 06:11:09,071 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:09,072 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. completed. 2023-07-16 06:11:09,072 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:09,074 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,074 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,074 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,075 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,076 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:09,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 06:11:09,094 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 06:11:09,094 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:09,094 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:09,094 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,094 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,100 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,101 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,101 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,105 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,105 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,106 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,122 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,122 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,122 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,122 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,123 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,124 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,223 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,225 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:09,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 06:11:09,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,266 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689487868908Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689487869123 (+215 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689487869124 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689487869145 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689487869176 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689487869265 (+89 ms) 2023-07-16 06:11:09,268 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 358 msec 2023-07-16 06:11:09,526 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:09,547 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:09,553 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:09,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43885] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:09,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:09,559 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 06:11:09,560 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:09,563 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:09,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487869589 (current time:1689487869589). 2023-07-16 06:11:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x20ea5d94 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79eddade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:09,602 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:09,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ea5d94 to 127.0.0.1:56819 2023-07-16 06:11:09,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:09,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x506b15dd to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229ff4b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:09,611 DEBUG [hconnection-0x35b3e11e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:09,613 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:09,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506b15dd to 127.0.0.1:56819 2023-07-16 06:11:09,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:09,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:09,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:09,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,624 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,625 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689488469625 2023-07-16 06:11:09,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 06:11:09,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,626 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:09,626 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:09,627 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-16 06:11:09,630 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,631 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689488469631 2023-07-16 06:11:09,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 06:11:09,654 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 06:11:09,654 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,655 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 06:11:09,655 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 06:11:09,656 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,656 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,657 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,657 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,657 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,661 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,661 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,663 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,664 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,666 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,666 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,666 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,667 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,667 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,667 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,667 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,667 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:09,673 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 06:11:09,673 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,677 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,677 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,678 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,678 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,678 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:09,678 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:09,678 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. started... 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,678 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,678 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. started... 2023-07-16 06:11:09,678 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5485babd8c89fc2bb69682de5675794a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 06:11:09,679 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b6878c3942e4404e9af8ed1703cf122c 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 06:11:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,726 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,729 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:09,788 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/.tmp/cf/797881d600d1456caaf5fe6981b36c4c 2023-07-16 06:11:09,796 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/.tmp/cf/90918cb4a70d47148b16ad75e7f170fc 2023-07-16 06:11:09,842 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/.tmp/cf/90918cb4a70d47148b16ad75e7f170fc as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc 2023-07-16 06:11:09,842 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/.tmp/cf/797881d600d1456caaf5fe6981b36c4c as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c 2023-07-16 06:11:09,852 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc, entries=5, sequenceid=6, filesize=5.2 K 2023-07-16 06:11:09,852 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c, entries=45, sequenceid=6, filesize=7.9 K 2023-07-16 06:11:09,858 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b6878c3942e4404e9af8ed1703cf122c in 180ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:09,858 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 06:11:09,858 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5485babd8c89fc2bb69682de5675794a in 180ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:09,858 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 06:11:09,860 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6878c3942e4404e9af8ed1703cf122c: 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5485babd8c89fc2bb69682de5675794a: 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c] hfiles 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:09,861 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc] hfiles 2023-07-16 06:11:09,862 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:09,902 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. completed. 2023-07-16 06:11:09,902 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:09,902 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. completed. 2023-07-16 06:11:09,902 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,902 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,902 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:09,902 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,902 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,903 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,903 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,902 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,903 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,903 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:09,903 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:09,905 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,905 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,905 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,905 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,906 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,906 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,907 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,907 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:09,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 06:11:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:11:09,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 06:11:09,918 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 06:11:09,918 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:09,918 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:09,918 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,918 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,922 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,922 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,923 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,925 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,925 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,925 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,930 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,938 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,938 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,939 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,939 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,940 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,940 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,940 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:09,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 06:11:09,941 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:09,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 06:11:09,941 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,941 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:09,942 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:09,942 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,942 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 06:11:10,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,061 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689487869625Consolidate snapshot: snaptb0-testExportWithTargetName at 1689487869941 (+316 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689487869941Writing data manifest for snaptb0-testExportWithTargetName at 1689487869954 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689487869985 (+31 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689487870060 (+75 ms) 2023-07-16 06:11:10,064 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:10,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 438 msec 2023-07-16 06:11:10,241 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:10,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:10,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:10,245 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245 2023-07-16 06:11:10,245 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33329, tgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245, rawTgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:10,300 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:10,300 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1573809134_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 06:11:10,300 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 06:11:10,320 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 06:11:10,420 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,421 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,422 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,422 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,423 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,423 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,424 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,519 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-3871274064521268398.jar 2023-07-16 06:11:10,519 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,520 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,520 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,521 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,521 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,523 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:10,523 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:10,524 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:10,525 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:10,525 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:10,526 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:10,527 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:10,527 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:10,528 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:10,529 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:10,535 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,535 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,536 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:10,536 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,537 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,537 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:10,538 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:11,550 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:11,557 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 06:11:11,565 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 06:11:12,023 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:12,025 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:12,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:13,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:17,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:19,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:22,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:24,556 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:24,559 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:24,568 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 06:11:24,568 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:24,568 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:24,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 06:11:24,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 06:11:24,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 06:11:24,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/testExportWithTargetName 2023-07-16 06:11:24,570 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 06:11:24,570 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487870245/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 06:11:24,580 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 06:11:24,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 06:11:24,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:24,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487884597"}]},"ts":"1689487884597"} 2023-07-16 06:11:24,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:24,599 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 06:11:24,696 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 06:11:24,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, UNASSIGN}] 2023-07-16 06:11:24,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:24,701 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, UNASSIGN 2023-07-16 06:11:24,701 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, UNASSIGN 2023-07-16 06:11:24,702 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5485babd8c89fc2bb69682de5675794a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:24,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b6878c3942e4404e9af8ed1703cf122c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:24,702 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487884702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487884702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487884702"}]},"ts":"1689487884702"} 2023-07-16 06:11:24,702 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487884702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487884702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487884702"}]},"ts":"1689487884702"} 2023-07-16 06:11:24,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5485babd8c89fc2bb69682de5675794a, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:11:24,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b6878c3942e4404e9af8ed1703cf122c, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:24,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:24,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5485babd8c89fc2bb69682de5675794a, disabling compactions & flushes 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6878c3942e4404e9af8ed1703cf122c, disabling compactions & flushes 2023-07-16 06:11:24,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:24,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. after waiting 0 ms 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. after waiting 0 ms 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:24,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:24,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:24,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:24,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:24,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:24,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c. 2023-07-16 06:11:24,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a. 2023-07-16 06:11:24,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6878c3942e4404e9af8ed1703cf122c: 2023-07-16 06:11:24,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5485babd8c89fc2bb69682de5675794a: 2023-07-16 06:11:24,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:24,884 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5485babd8c89fc2bb69682de5675794a, regionState=CLOSED 2023-07-16 06:11:24,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:24,885 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487884884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487884884"}]},"ts":"1689487884884"} 2023-07-16 06:11:24,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b6878c3942e4404e9af8ed1703cf122c, regionState=CLOSED 2023-07-16 06:11:24,886 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487884885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487884885"}]},"ts":"1689487884885"} 2023-07-16 06:11:24,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-16 06:11:24,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5485babd8c89fc2bb69682de5675794a, server=jenkins-hbase4.apache.org,43885,1689487858173 in 183 msec 2023-07-16 06:11:24,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-16 06:11:24,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b6878c3942e4404e9af8ed1703cf122c, server=jenkins-hbase4.apache.org,33137,1689487858246 in 183 msec 2023-07-16 06:11:24,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5485babd8c89fc2bb69682de5675794a, UNASSIGN in 191 msec 2023-07-16 06:11:24,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 06:11:24,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b6878c3942e4404e9af8ed1703cf122c, UNASSIGN in 191 msec 2023-07-16 06:11:24,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487884896"}]},"ts":"1689487884896"} 2023-07-16 06:11:24,898 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 06:11:24,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:24,981 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 06:11:24,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 396 msec 2023-07-16 06:11:25,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:25,202 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 06:11:25,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 06:11:25,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 06:11:25,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,223 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 06:11:25,225 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:25,225 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:25,228 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/recovered.edits] 2023-07-16 06:11:25,228 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/recovered.edits] 2023-07-16 06:11:25,236 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/cf/90918cb4a70d47148b16ad75e7f170fc 2023-07-16 06:11:25,236 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/cf/797881d600d1456caaf5fe6981b36c4c 2023-07-16 06:11:25,240 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a/recovered.edits/9.seqid 2023-07-16 06:11:25,240 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c/recovered.edits/9.seqid 2023-07-16 06:11:25,240 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/5485babd8c89fc2bb69682de5675794a 2023-07-16 06:11:25,241 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportWithTargetName/b6878c3942e4404e9af8ed1703cf122c 2023-07-16 06:11:25,241 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 06:11:25,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,266 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 06:11:25,412 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,412 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,412 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,412 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 06:11:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 06:11:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 06:11:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 06:11:25,416 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 06:11:25,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 06:11:25,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487885418"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487885418"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,430 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:11:25,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5485babd8c89fc2bb69682de5675794a, NAME => 'testtb-testExportWithTargetName,,1689487867651.5485babd8c89fc2bb69682de5675794a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b6878c3942e4404e9af8ed1703cf122c, NAME => 'testtb-testExportWithTargetName,1,1689487867651.b6878c3942e4404e9af8ed1703cf122c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:11:25,430 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 06:11:25,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487885430"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,436 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 06:11:25,496 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,496 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,496 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,496 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,497 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,497 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,497 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,497 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 06:11:25,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 382 msec 2023-07-16 06:11:25,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 06:11:25,601 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 06:11:25,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 06:11:25,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:25,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 06:11:25,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 06:11:25,656 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 708) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:37493 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_402847834_1 at /127.0.0.1:39098 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:43747 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:41058 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_402847834_1 at /127.0.0.1:41032 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:39124 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:45836 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=401 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=3365 (was 4903) 2023-07-16 06:11:25,657 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-16 06:11:25,677 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=180, AvailableMemoryMB=3363 2023-07-16 06:11:25,678 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-16 06:11:25,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:25,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:25,684 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:25,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 06:11:25,686 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:25,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:25,688 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:25,688 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:25,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 empty. 2023-07-16 06:11:25,689 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 empty. 2023-07-16 06:11:25,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:25,690 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:25,690 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 06:11:25,713 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:25,714 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef72f1bf4f19c8a0bd759745664f4ba8, NAME => 'testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:25,715 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a35cb255503faac7efd14513eb76ec8, NAME => 'testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:25,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:25,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ef72f1bf4f19c8a0bd759745664f4ba8, disabling compactions & flushes 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8a35cb255503faac7efd14513eb76ec8, disabling compactions & flushes 2023-07-16 06:11:25,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:25,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. after waiting 0 ms 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. after waiting 0 ms 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:25,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:25,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ef72f1bf4f19c8a0bd759745664f4ba8: 2023-07-16 06:11:25,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8a35cb255503faac7efd14513eb76ec8: 2023-07-16 06:11:25,745 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:25,746 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487885746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487885746"}]},"ts":"1689487885746"} 2023-07-16 06:11:25,746 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487885746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487885746"}]},"ts":"1689487885746"} 2023-07-16 06:11:25,749 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:25,750 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:25,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487885750"}]},"ts":"1689487885750"} 2023-07-16 06:11:25,751 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 06:11:25,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:25,904 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:25,906 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:25,907 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:25,907 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:25,907 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:25,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, ASSIGN}] 2023-07-16 06:11:25,911 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, ASSIGN 2023-07-16 06:11:25,911 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, ASSIGN 2023-07-16 06:11:25,912 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:11:25,913 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43885,1689487858173; forceNewPlan=false, retain=false 2023-07-16 06:11:25,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,063 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:26,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8a35cb255503faac7efd14513eb76ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:26,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ef72f1bf4f19c8a0bd759745664f4ba8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:26,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487886066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487886066"}]},"ts":"1689487886066"} 2023-07-16 06:11:26,066 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487886066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487886066"}]},"ts":"1689487886066"} 2023-07-16 06:11:26,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 8a35cb255503faac7efd14513eb76ec8, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:26,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure ef72f1bf4f19c8a0bd759745664f4ba8, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:11:26,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:26,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a35cb255503faac7efd14513eb76ec8, NAME => 'testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. service=AccessControlService 2023-07-16 06:11:26,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:26,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef72f1bf4f19c8a0bd759745664f4ba8, NAME => 'testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. service=AccessControlService 2023-07-16 06:11:26,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:26,228 INFO [StoreOpener-8a35cb255503faac7efd14513eb76ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,230 INFO [StoreOpener-ef72f1bf4f19c8a0bd759745664f4ba8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,230 DEBUG [StoreOpener-8a35cb255503faac7efd14513eb76ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf 2023-07-16 06:11:26,230 DEBUG [StoreOpener-8a35cb255503faac7efd14513eb76ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf 2023-07-16 06:11:26,230 INFO [StoreOpener-8a35cb255503faac7efd14513eb76ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a35cb255503faac7efd14513eb76ec8 columnFamilyName cf 2023-07-16 06:11:26,231 INFO [StoreOpener-8a35cb255503faac7efd14513eb76ec8-1] regionserver.HStore(310): Store=8a35cb255503faac7efd14513eb76ec8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:26,231 DEBUG [StoreOpener-ef72f1bf4f19c8a0bd759745664f4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf 2023-07-16 06:11:26,233 DEBUG [StoreOpener-ef72f1bf4f19c8a0bd759745664f4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf 2023-07-16 06:11:26,233 INFO [StoreOpener-ef72f1bf4f19c8a0bd759745664f4ba8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef72f1bf4f19c8a0bd759745664f4ba8 columnFamilyName cf 2023-07-16 06:11:26,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,234 INFO [StoreOpener-ef72f1bf4f19c8a0bd759745664f4ba8-1] regionserver.HStore(310): Store=ef72f1bf4f19c8a0bd759745664f4ba8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:26,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:26,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:26,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:26,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a35cb255503faac7efd14513eb76ec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59622972, jitterRate=-0.11154848337173462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:26,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a35cb255503faac7efd14513eb76ec8: 2023-07-16 06:11:26,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:26,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef72f1bf4f19c8a0bd759745664f4ba8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73456060, jitterRate=0.09458059072494507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:26,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8., pid=30, masterSystemTime=1689487886221 2023-07-16 06:11:26,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef72f1bf4f19c8a0bd759745664f4ba8: 2023-07-16 06:11:26,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8., pid=31, masterSystemTime=1689487886223 2023-07-16 06:11:26,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:26,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:26,246 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8a35cb255503faac7efd14513eb76ec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:26,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:26,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:26,246 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886246"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487886246"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487886246"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487886246"}]},"ts":"1689487886246"} 2023-07-16 06:11:26,247 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ef72f1bf4f19c8a0bd759745664f4ba8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:26,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487886247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487886247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487886247"}]},"ts":"1689487886247"} 2023-07-16 06:11:26,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-16 06:11:26,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 8a35cb255503faac7efd14513eb76ec8, server=jenkins-hbase4.apache.org,33137,1689487858246 in 179 msec 2023-07-16 06:11:26,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-16 06:11:26,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure ef72f1bf4f19c8a0bd759745664f4ba8, server=jenkins-hbase4.apache.org,43885,1689487858173 in 180 msec 2023-07-16 06:11:26,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, ASSIGN in 346 msec 2023-07-16 06:11:26,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 06:11:26,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, ASSIGN in 348 msec 2023-07-16 06:11:26,259 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:26,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487886259"}]},"ts":"1689487886259"} 2023-07-16 06:11:26,261 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 06:11:26,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:26,321 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 06:11:26,323 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:26,366 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,366 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,366 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,366 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,428 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,428 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,428 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,428 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 746 msec 2023-07-16 06:11:26,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,792 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 06:11:26,792 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 06:11:26,792 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:26,796 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 06:11:26,796 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:26,796 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-16 06:11:26,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487886801 (current time:1689487886801). 2023-07-16 06:11:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x6fc2c0d4 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:26,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e05e5b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:26,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:26,842 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:26,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fc2c0d4 to 127.0.0.1:56819 2023-07-16 06:11:26,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x7c8fe7df to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:26,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5325cfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:26,930 DEBUG [hconnection-0x34ab21ad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:26,931 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c8fe7df to 127.0.0.1:56819 2023-07-16 06:11:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:26,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:26,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:26,944 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:26,945 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488486945 2023-07-16 06:11:26,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 06:11:26,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:26,947 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:26,947 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:26,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:26,948 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:26,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 06:11:26,951 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:26,952 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488486952 2023-07-16 06:11:26,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:26,971 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 06:11:26,971 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:26,973 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 06:11:26,973 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:11:26,996 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:26,996 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,047 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:27,049 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:27,058 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,058 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,058 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,058 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,058 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,059 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,059 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,060 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,064 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,178 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,178 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,178 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,178 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,178 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:27,184 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:11:27,184 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,219 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,219 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,219 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:27,220 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,220 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:27,220 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,221 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. started... 2023-07-16 06:11:27,220 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:27,221 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,220 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:27,223 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. started... 2023-07-16 06:11:27,223 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a35cb255503faac7efd14513eb76ec8: 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef72f1bf4f19c8a0bd759745664f4ba8: 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,224 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:27,244 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. completed. 2023-07-16 06:11:27,244 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:27,247 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. completed. 2023-07-16 06:11:27,247 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:27,247 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,247 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,248 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,248 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,248 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:27,249 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:27,251 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,319 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,319 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,320 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,320 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,374 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,374 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,374 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,374 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:27,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:11:27,386 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 06:11:27,386 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:27,386 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:27,386 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,386 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:27,442 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,442 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,442 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,443 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,444 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,444 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,446 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,447 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,447 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,465 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,466 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,466 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,469 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,469 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,469 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 06:11:27,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,538 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689487886945Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689487887466 (+521 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689487887466Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689487887472 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689487887484 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689487887537 (+53 ms) 2023-07-16 06:11:27,541 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 595 msec 2023-07-16 06:11:27,551 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:27,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:27,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:27,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 06:11:27,569 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:27,570 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:27,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487887584 (current time:1689487887584). 2023-07-16 06:11:27,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:27,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x64a7100f to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@198ee124, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,600 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64a7100f to 127.0.0.1:56819 2023-07-16 06:11:27,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x1c9cb9b9 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e0ebbb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,617 DEBUG [hconnection-0x1b4cca8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,620 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c9cb9b9 to 127.0.0.1:56819 2023-07-16 06:11:27,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:27,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:27,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,630 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,633 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488487633 2023-07-16 06:11:27,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 06:11:27,635 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:27,635 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:27,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,638 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-16 06:11:27,641 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,642 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488487642 2023-07-16 06:11:27,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 06:11:27,661 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 06:11:27,661 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,663 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 06:11:27,663 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:11:27,663 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,663 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,665 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,665 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,665 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,666 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,667 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,668 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,670 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,671 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,671 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,671 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,671 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,673 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,674 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,675 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:27,683 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:11:27,683 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,685 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:27,685 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,686 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,686 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,686 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,686 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:27,686 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,686 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. started... 2023-07-16 06:11:27,686 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:27,686 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:27,686 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. started... 2023-07-16 06:11:27,686 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a35cb255503faac7efd14513eb76ec8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 06:11:27,686 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ef72f1bf4f19c8a0bd759745664f4ba8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 06:11:27,688 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,688 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,688 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,713 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/.tmp/cf/b625627b541b4700b598ad8f7acd7644 2023-07-16 06:11:27,714 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/.tmp/cf/da4dafa9815a4c17a2570c6b7ed72447 2023-07-16 06:11:27,727 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/.tmp/cf/b625627b541b4700b598ad8f7acd7644 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644 2023-07-16 06:11:27,727 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/.tmp/cf/da4dafa9815a4c17a2570c6b7ed72447 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447 2023-07-16 06:11:27,734 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 06:11:27,734 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 06:11:27,736 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,737 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ef72f1bf4f19c8a0bd759745664f4ba8 in 51ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:27,737 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 06:11:27,737 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8a35cb255503faac7efd14513eb76ec8 in 51ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:27,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,738 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 06:11:27,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef72f1bf4f19c8a0bd759745664f4ba8: 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a35cb255503faac7efd14513eb76ec8: 2023-07-16 06:11:27,741 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644] hfiles 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447] hfiles 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:27,741 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:27,775 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. completed. 2023-07-16 06:11:27,775 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,780 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:11:27,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:11:27,793 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. completed. 2023-07-16 06:11:27,793 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:27,794 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,795 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,795 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,795 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:27,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:11:27,800 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 06:11:27,800 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:27,800 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:27,800 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,800 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:27,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,803 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,803 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,804 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,806 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,808 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,808 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,808 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,812 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,812 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,813 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:27,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:27,813 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,814 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,817 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,817 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,818 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,818 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 06:11:27,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,873 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689487887634Consolidate snapshot: snaptb0-testExportFileSystemState at 1689487887813 (+179 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689487887813Writing data manifest for snaptb0-testExportFileSystemState at 1689487887820 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689487887832 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689487887872 (+40 ms) 2023-07-16 06:11:27,876 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 241 msec 2023-07-16 06:11:27,941 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:27,945 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945 2023-07-16 06:11:27,945 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33329, tgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945, rawTgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:27,979 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:27,979 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-995057412_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,979 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 06:11:27,991 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,024 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,024 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,025 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,025 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,025 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,100 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-9119487287985466108.jar 2023-07-16 06:11:28,101 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,101 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,102 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,102 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,103 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,103 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:28,107 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:28,107 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:28,109 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:28,109 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:28,109 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:28,109 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:28,110 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:28,626 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:28,629 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 06:11:28,631 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 06:11:28,956 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:28,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:28,964 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:29,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:30,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:34,276 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:36,504 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:40,857 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:40,858 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:40,867 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 06:11:40,867 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:40,868 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:40,868 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:40,869 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 06:11:40,869 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 06:11:40,869 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:40,906 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 06:11:40,907 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487887945/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 06:11:40,916 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 06:11:40,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 06:11:40,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:40,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487900923"}]},"ts":"1689487900923"} 2023-07-16 06:11:40,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 06:11:40,927 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 06:11:40,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, UNASSIGN}] 2023-07-16 06:11:40,930 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, UNASSIGN 2023-07-16 06:11:40,931 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, UNASSIGN 2023-07-16 06:11:40,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ef72f1bf4f19c8a0bd759745664f4ba8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:40,932 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8a35cb255503faac7efd14513eb76ec8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:40,932 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487900932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487900932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487900932"}]},"ts":"1689487900932"} 2023-07-16 06:11:40,932 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487900932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487900932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487900932"}]},"ts":"1689487900932"} 2023-07-16 06:11:40,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure ef72f1bf4f19c8a0bd759745664f4ba8, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:11:40,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 8a35cb255503faac7efd14513eb76ec8, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:41,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:41,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:41,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a35cb255503faac7efd14513eb76ec8, disabling compactions & flushes 2023-07-16 06:11:41,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:41,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:41,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. after waiting 0 ms 2023-07-16 06:11:41,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:41,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:41,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef72f1bf4f19c8a0bd759745664f4ba8, disabling compactions & flushes 2023-07-16 06:11:41,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:41,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:41,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. after waiting 0 ms 2023-07-16 06:11:41,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:41,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:41,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:41,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:41,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8. 2023-07-16 06:11:41,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a35cb255503faac7efd14513eb76ec8: 2023-07-16 06:11:41,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:41,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8. 2023-07-16 06:11:41,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef72f1bf4f19c8a0bd759745664f4ba8: 2023-07-16 06:11:41,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:41,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8a35cb255503faac7efd14513eb76ec8, regionState=CLOSED 2023-07-16 06:11:41,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487901119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487901119"}]},"ts":"1689487901119"} 2023-07-16 06:11:41,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:41,121 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ef72f1bf4f19c8a0bd759745664f4ba8, regionState=CLOSED 2023-07-16 06:11:41,121 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487901121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487901121"}]},"ts":"1689487901121"} 2023-07-16 06:11:41,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 06:11:41,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 8a35cb255503faac7efd14513eb76ec8, server=jenkins-hbase4.apache.org,33137,1689487858246 in 186 msec 2023-07-16 06:11:41,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 06:11:41,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8a35cb255503faac7efd14513eb76ec8, UNASSIGN in 197 msec 2023-07-16 06:11:41,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure ef72f1bf4f19c8a0bd759745664f4ba8, server=jenkins-hbase4.apache.org,43885,1689487858173 in 189 msec 2023-07-16 06:11:41,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-16 06:11:41,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ef72f1bf4f19c8a0bd759745664f4ba8, UNASSIGN in 199 msec 2023-07-16 06:11:41,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487901129"}]},"ts":"1689487901129"} 2023-07-16 06:11:41,131 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 06:11:41,133 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 06:11:41,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 217 msec 2023-07-16 06:11:41,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:41,226 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 06:11:41,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 06:11:41,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,232 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 06:11:41,233 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,235 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 06:11:41,238 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,238 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,238 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,238 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:41,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:41,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:41,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:41,240 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:41,240 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,240 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 06:11:41,242 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/recovered.edits] 2023-07-16 06:11:41,243 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/recovered.edits] 2023-07-16 06:11:41,250 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/cf/da4dafa9815a4c17a2570c6b7ed72447 2023-07-16 06:11:41,263 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/cf/b625627b541b4700b598ad8f7acd7644 2023-07-16 06:11:41,266 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8/recovered.edits/9.seqid 2023-07-16 06:11:41,267 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/8a35cb255503faac7efd14513eb76ec8 2023-07-16 06:11:41,269 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8/recovered.edits/9.seqid 2023-07-16 06:11:41,269 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemState/ef72f1bf4f19c8a0bd759745664f4ba8 2023-07-16 06:11:41,269 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 06:11:41,272 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,277 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 06:11:41,293 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 06:11:41,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 06:11:41,296 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487901296"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:41,296 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487901296"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:41,299 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:11:41,299 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef72f1bf4f19c8a0bd759745664f4ba8, NAME => 'testtb-testExportFileSystemState,,1689487885679.ef72f1bf4f19c8a0bd759745664f4ba8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a35cb255503faac7efd14513eb76ec8, NAME => 'testtb-testExportFileSystemState,1,1689487885679.8a35cb255503faac7efd14513eb76ec8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:11:41,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 06:11:41,299 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487901299"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:41,301 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 06:11:41,303 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:41,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 76 msec 2023-07-16 06:11:41,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 06:11:41,343 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 06:11:41,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 06:11:41,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:41,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 06:11:41,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 06:11:41,394 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=766 (was 756) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-483893886_1 at /127.0.0.1:35728 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:34498 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:37468 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:37085 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-483893886_1 at /127.0.0.1:40604 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:53826 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=407 (was 401) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=2892 (was 3363) 2023-07-16 06:11:41,394 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-16 06:11:41,417 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=407, ProcessCount=180, AvailableMemoryMB=2891 2023-07-16 06:11:41,417 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-16 06:11:41,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:41,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:11:41,422 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:41,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 06:11:41,423 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:41,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:41,426 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,426 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,427 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 empty. 2023-07-16 06:11:41,427 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad empty. 2023-07-16 06:11:41,427 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,427 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,427 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 06:11:41,441 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:41,443 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61d4ef5e3e5d5ef3d3eeab65d4525d64, NAME => 'testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:41,443 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => cd83f820a65a6f849b6c8d5fb76334ad, NAME => 'testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:11:41,455 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:41,456 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 61d4ef5e3e5d5ef3d3eeab65d4525d64, disabling compactions & flushes 2023-07-16 06:11:41,456 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,456 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,456 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. after waiting 0 ms 2023-07-16 06:11:41,456 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,456 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,456 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 61d4ef5e3e5d5ef3d3eeab65d4525d64: 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing cd83f820a65a6f849b6c8d5fb76334ad, disabling compactions & flushes 2023-07-16 06:11:41,471 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. after waiting 0 ms 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,471 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,471 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for cd83f820a65a6f849b6c8d5fb76334ad: 2023-07-16 06:11:41,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:41,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487901475"}]},"ts":"1689487901475"} 2023-07-16 06:11:41,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487901475"}]},"ts":"1689487901475"} 2023-07-16 06:11:41,478 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:41,479 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:41,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487901479"}]},"ts":"1689487901479"} 2023-07-16 06:11:41,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 06:11:41,487 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:41,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:41,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:41,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:41,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:41,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, ASSIGN}] 2023-07-16 06:11:41,492 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, ASSIGN 2023-07-16 06:11:41,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, ASSIGN 2023-07-16 06:11:41,494 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39467,1689487858304; forceNewPlan=false, retain=false 2023-07-16 06:11:41,494 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:11:41,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:41,644 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:41,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=61d4ef5e3e5d5ef3d3eeab65d4525d64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:41,646 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cd83f820a65a6f849b6c8d5fb76334ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:41,647 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487901646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487901646"}]},"ts":"1689487901646"} 2023-07-16 06:11:41,647 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487901646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487901646"}]},"ts":"1689487901646"} 2023-07-16 06:11:41,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 61d4ef5e3e5d5ef3d3eeab65d4525d64, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:11:41,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure cd83f820a65a6f849b6c8d5fb76334ad, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:11:41,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:41,803 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:41,803 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:41,807 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:41,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61d4ef5e3e5d5ef3d3eeab65d4525d64, NAME => 'testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:41,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. service=AccessControlService 2023-07-16 06:11:41,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,811 INFO [StoreOpener-61d4ef5e3e5d5ef3d3eeab65d4525d64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd83f820a65a6f849b6c8d5fb76334ad, NAME => 'testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:41,813 DEBUG [StoreOpener-61d4ef5e3e5d5ef3d3eeab65d4525d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf 2023-07-16 06:11:41,813 DEBUG [StoreOpener-61d4ef5e3e5d5ef3d3eeab65d4525d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf 2023-07-16 06:11:41,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. service=AccessControlService 2023-07-16 06:11:41,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:41,813 INFO [StoreOpener-61d4ef5e3e5d5ef3d3eeab65d4525d64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61d4ef5e3e5d5ef3d3eeab65d4525d64 columnFamilyName cf 2023-07-16 06:11:41,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:41,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,814 INFO [StoreOpener-61d4ef5e3e5d5ef3d3eeab65d4525d64-1] regionserver.HStore(310): Store=61d4ef5e3e5d5ef3d3eeab65d4525d64/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:41,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,815 INFO [StoreOpener-cd83f820a65a6f849b6c8d5fb76334ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,817 DEBUG [StoreOpener-cd83f820a65a6f849b6c8d5fb76334ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf 2023-07-16 06:11:41,817 DEBUG [StoreOpener-cd83f820a65a6f849b6c8d5fb76334ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf 2023-07-16 06:11:41,817 INFO [StoreOpener-cd83f820a65a6f849b6c8d5fb76334ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd83f820a65a6f849b6c8d5fb76334ad columnFamilyName cf 2023-07-16 06:11:41,818 INFO [StoreOpener-cd83f820a65a6f849b6c8d5fb76334ad-1] regionserver.HStore(310): Store=cd83f820a65a6f849b6c8d5fb76334ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:41,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:11:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:41,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61d4ef5e3e5d5ef3d3eeab65d4525d64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64834411, jitterRate=-0.03389199078083038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:41,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61d4ef5e3e5d5ef3d3eeab65d4525d64: 2023-07-16 06:11:41,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:11:41,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64., pid=45, masterSystemTime=1689487901801 2023-07-16 06:11:41,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:41,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:41,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=61d4ef5e3e5d5ef3d3eeab65d4525d64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:41,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487901827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487901827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487901827"}]},"ts":"1689487901827"} 2023-07-16 06:11:41,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cd83f820a65a6f849b6c8d5fb76334ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73004160, jitterRate=0.08784675598144531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:41,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cd83f820a65a6f849b6c8d5fb76334ad: 2023-07-16 06:11:41,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad., pid=46, masterSystemTime=1689487901803 2023-07-16 06:11:41,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:41,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 06:11:41,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 61d4ef5e3e5d5ef3d3eeab65d4525d64, server=jenkins-hbase4.apache.org,33137,1689487858246 in 182 msec 2023-07-16 06:11:41,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cd83f820a65a6f849b6c8d5fb76334ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:41,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487901838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487901838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487901838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487901838"}]},"ts":"1689487901838"} 2023-07-16 06:11:41,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, ASSIGN in 349 msec 2023-07-16 06:11:41,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 06:11:41,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure cd83f820a65a6f849b6c8d5fb76334ad, server=jenkins-hbase4.apache.org,39467,1689487858304 in 191 msec 2023-07-16 06:11:41,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-16 06:11:41,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, ASSIGN in 354 msec 2023-07-16 06:11:41,846 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:41,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487901846"}]},"ts":"1689487901846"} 2023-07-16 06:11:41,848 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 06:11:41,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:41,850 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 06:11:41,853 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:41,859 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,859 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,859 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,859 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:41,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:41,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:41,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:41,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:41,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 442 msec 2023-07-16 06:11:42,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:42,028 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 06:11:42,028 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-16 06:11:42,028 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:42,031 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-16 06:11:42,031 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:42,031 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-16 06:11:42,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487902034 (current time:1689487902034). 2023-07-16 06:11:42,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:42,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x7ccde49b to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:42,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30447577, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:42,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:42,044 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:42,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ccde49b to 127.0.0.1:56819 2023-07-16 06:11:42,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x5baea0c7 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:42,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48d28908, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:42,053 DEBUG [hconnection-0x1ea186fd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:42,056 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:42,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5baea0c7 to 127.0.0.1:56819 2023-07-16 06:11:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:42,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,065 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,065 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689488502065 2023-07-16 06:11:42,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 06:11:42,066 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:42,068 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 06:11:42,070 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,070 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689488502070 2023-07-16 06:11:42,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,083 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 06:11:42,083 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,084 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 06:11:42,084 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 06:11:42,085 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,085 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,087 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,087 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,087 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,088 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,088 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,089 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,097 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,097 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:42,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:42,102 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 06:11:42,102 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,103 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,103 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:42,103 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:42,103 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,103 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. started... 2023-07-16 06:11:42,103 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. started... 2023-07-16 06:11:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:42,105 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd83f820a65a6f849b6c8d5fb76334ad: 2023-07-16 06:11:42,106 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61d4ef5e3e5d5ef3d3eeab65d4525d64: 2023-07-16 06:11:42,106 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,106 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,106 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:42,107 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:42,107 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:42,107 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,119 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. completed. 2023-07-16 06:11:42,119 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. completed. 2023-07-16 06:11:42,119 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:42,119 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:42,119 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:42,121 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,121 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,121 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,121 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,123 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:11:42,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:42,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 06:11:42,131 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 06:11:42,131 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:42,131 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:42,131 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,131 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,133 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,134 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,135 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,137 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,137 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,138 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,142 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,142 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,141 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,141 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,142 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,143 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,144 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,144 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,167 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:42,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:42,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:42,168 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:42,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 06:11:42,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,192 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:42,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689487902066Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689487902142 (+76 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689487902143 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689487902147 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689487902155 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689487902191 (+36 ms) 2023-07-16 06:11:42,198 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 132 msec 2023-07-16 06:11:42,368 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:42,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:42,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:42,376 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:42,382 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:42,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:42,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39467] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:42,386 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 06:11:42,386 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:42,387 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:42,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487902399 (current time:1689487902399). 2023-07-16 06:11:42,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:42,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x153910d5 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:42,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@caa7e7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:42,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:42,422 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x153910d5 to 127.0.0.1:56819 2023-07-16 06:11:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:42,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x3f254e97 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:42,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6023a6ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:42,433 DEBUG [hconnection-0x50218c97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:42,434 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f254e97 to 127.0.0.1:56819 2023-07-16 06:11:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:42,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:42,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,443 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,444 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689488502444 2023-07-16 06:11:42,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 06:11:42,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:42,445 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:42,445 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:42,446 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:42,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 06:11:42,448 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,449 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689488502448 2023-07-16 06:11:42,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 06:11:42,459 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 06:11:42,459 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,460 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 06:11:42,460 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 06:11:42,460 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,460 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,461 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,461 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,461 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,461 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,462 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,462 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,462 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,462 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:42,463 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,463 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,463 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,463 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,465 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,464 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,466 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:42,467 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:42,467 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:42,467 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:42,468 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,468 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,469 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,470 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:42,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:42,474 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 06:11:42,474 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:42,476 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,476 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,476 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:42,476 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. started... 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:42,477 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:11:42,477 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. started... 2023-07-16 06:11:42,477 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cd83f820a65a6f849b6c8d5fb76334ad 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:11:42,477 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61d4ef5e3e5d5ef3d3eeab65d4525d64 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:11:42,479 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,479 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,479 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,494 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/.tmp/cf/921ac6c88b80430cbdfc1c2ba54bef6b 2023-07-16 06:11:42,495 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/.tmp/cf/f50b1495101c45a19de4ece50b24ec00 2023-07-16 06:11:42,500 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/.tmp/cf/921ac6c88b80430cbdfc1c2ba54bef6b as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b 2023-07-16 06:11:42,501 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/.tmp/cf/f50b1495101c45a19de4ece50b24ec00 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00 2023-07-16 06:11:42,506 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00, entries=47, sequenceid=6, filesize=8.0 K 2023-07-16 06:11:42,506 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 06:11:42,507 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cd83f820a65a6f849b6c8d5fb76334ad in 30ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:42,507 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 61d4ef5e3e5d5ef3d3eeab65d4525d64 in 30ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:42,507 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 06:11:42,507 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 06:11:42,509 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd83f820a65a6f849b6c8d5fb76334ad: 2023-07-16 06:11:42,509 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61d4ef5e3e5d5ef3d3eeab65d4525d64: 2023-07-16 06:11:42,509 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b] hfiles 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00] hfiles 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:42,510 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:42,517 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. completed. 2023-07-16 06:11:42,517 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:11:42,518 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. completed. 2023-07-16 06:11:42,518 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:42,518 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:11:42,519 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,519 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:42,521 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,521 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:11:42,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 06:11:42,534 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 06:11:42,534 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:42,534 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:42,534 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 06:11:42,534 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:42,535 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,535 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:42,535 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,535 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,535 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:42,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,536 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,537 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,539 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:42,539 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:42,540 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,545 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:11:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:42,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 06:11:42,547 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:42,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:11:42,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,546 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:42,549 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:42,549 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,549 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:42,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:42,549 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:42,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 06:11:42,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,588 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689487902444Consolidate snapshot: snaptb0-testConsecutiveExports at 1689487902547 (+103 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689487902547Writing data manifest for snaptb0-testConsecutiveExports at 1689487902553 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689487902561 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689487902588 (+27 ms) 2023-07-16 06:11:42,591 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:42,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 146 msec 2023-07-16 06:11:42,749 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:42,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:42,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:42,750 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750 2023-07-16 06:11:42,751 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:42,773 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:42,773 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@52c181df, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,773 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 06:11:42,781 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:42,799 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,800 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,800 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,800 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,883 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-1784094890933551798.jar 2023-07-16 06:11:42,883 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,884 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,884 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,884 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,885 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,885 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:42,885 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:42,886 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:42,886 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:42,887 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:42,887 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:42,887 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:42,888 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:42,888 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:42,888 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:42,889 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:42,889 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:42,890 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:42,891 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:42,891 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:42,891 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:42,892 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:42,893 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:43,814 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:43,817 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 06:11:43,819 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 06:11:45,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:45,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:45,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:45,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:46,698 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:50,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:52,309 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:55,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:57,010 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:57,010 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:57,014 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 06:11:57,014 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:57,015 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:57,015 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:57,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:11:57,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:11:57,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58b86ef1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:57,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:11:57,016 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:11:57,018 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:57,044 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:11:57,044 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@76ac863d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:57,044 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 06:11:57,058 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:57,073 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,073 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,074 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,075 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,075 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,146 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-425961534070958015.jar 2023-07-16 06:11:57,146 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,147 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,147 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,148 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,148 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,148 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:57,149 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:57,149 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:57,149 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:57,150 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:57,150 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:57,150 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:57,151 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:57,151 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:57,151 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:57,152 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:57,152 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:57,153 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:57,153 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:57,153 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:57,154 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:57,154 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:57,155 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:57,639 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:57,641 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 06:11:57,643 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 06:12:01,572 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:01,572 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:01,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0003_000001 (auth:SIMPLE) 2023-07-16 06:12:02,359 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:06,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:08,714 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:12,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:13,846 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:13,846 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:13,849 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 06:12:13,849 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:13,850 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:13,850 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:12:13,853 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:12:13,853 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:12:13,853 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58b86ef1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:12:13,854 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:12:13,854 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/local-export-1689487902750/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:12:13,865 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 06:12:13,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 06:12:13,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:13,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:13,871 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487933870"}]},"ts":"1689487933870"} 2023-07-16 06:12:13,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 06:12:13,874 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 06:12:13,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, UNASSIGN}] 2023-07-16 06:12:13,877 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, UNASSIGN 2023-07-16 06:12:13,877 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, UNASSIGN 2023-07-16 06:12:13,878 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cd83f820a65a6f849b6c8d5fb76334ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:13,878 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=61d4ef5e3e5d5ef3d3eeab65d4525d64, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:13,878 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487933878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487933878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487933878"}]},"ts":"1689487933878"} 2023-07-16 06:12:13,878 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487933878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487933878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487933878"}]},"ts":"1689487933878"} 2023-07-16 06:12:13,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure cd83f820a65a6f849b6c8d5fb76334ad, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:13,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 61d4ef5e3e5d5ef3d3eeab65d4525d64, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:12:13,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:14,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:12:14,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61d4ef5e3e5d5ef3d3eeab65d4525d64, disabling compactions & flushes 2023-07-16 06:12:14,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:12:14,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:12:14,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. after waiting 0 ms 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cd83f820a65a6f849b6c8d5fb76334ad, disabling compactions & flushes 2023-07-16 06:12:14,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. after waiting 0 ms 2023-07-16 06:12:14,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:12:14,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:14,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:14,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:14,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:14,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad. 2023-07-16 06:12:14,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64. 2023-07-16 06:12:14,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61d4ef5e3e5d5ef3d3eeab65d4525d64: 2023-07-16 06:12:14,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cd83f820a65a6f849b6c8d5fb76334ad: 2023-07-16 06:12:14,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:12:14,050 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=61d4ef5e3e5d5ef3d3eeab65d4525d64, regionState=CLOSED 2023-07-16 06:12:14,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487934050"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487934050"}]},"ts":"1689487934050"} 2023-07-16 06:12:14,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:12:14,051 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cd83f820a65a6f849b6c8d5fb76334ad, regionState=CLOSED 2023-07-16 06:12:14,051 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487934051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487934051"}]},"ts":"1689487934051"} 2023-07-16 06:12:14,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-16 06:12:14,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 61d4ef5e3e5d5ef3d3eeab65d4525d64, server=jenkins-hbase4.apache.org,33137,1689487858246 in 171 msec 2023-07-16 06:12:14,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-16 06:12:14,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure cd83f820a65a6f849b6c8d5fb76334ad, server=jenkins-hbase4.apache.org,39467,1689487858304 in 173 msec 2023-07-16 06:12:14,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61d4ef5e3e5d5ef3d3eeab65d4525d64, UNASSIGN in 179 msec 2023-07-16 06:12:14,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-16 06:12:14,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cd83f820a65a6f849b6c8d5fb76334ad, UNASSIGN in 181 msec 2023-07-16 06:12:14,058 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487934058"}]},"ts":"1689487934058"} 2023-07-16 06:12:14,059 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 06:12:14,060 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 06:12:14,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-07-16 06:12:14,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:14,172 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 06:12:14,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 06:12:14,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 06:12:14,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,180 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 06:12:14,183 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,183 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,183 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,183 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:14,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:14,183 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:12:14,184 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:12:14,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:14,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:14,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/recovered.edits] 2023-07-16 06:12:14,185 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/recovered.edits] 2023-07-16 06:12:14,185 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,185 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,185 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,186 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,185 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,186 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,186 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:14,186 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 06:12:14,194 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/cf/921ac6c88b80430cbdfc1c2ba54bef6b 2023-07-16 06:12:14,195 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/cf/f50b1495101c45a19de4ece50b24ec00 2023-07-16 06:12:14,199 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad/recovered.edits/9.seqid 2023-07-16 06:12:14,199 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64/recovered.edits/9.seqid 2023-07-16 06:12:14,200 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/cd83f820a65a6f849b6c8d5fb76334ad 2023-07-16 06:12:14,200 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testConsecutiveExports/61d4ef5e3e5d5ef3d3eeab65d4525d64 2023-07-16 06:12:14,200 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 06:12:14,203 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,205 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 06:12:14,208 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 06:12:14,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 06:12:14,209 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487934209"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:14,209 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487934209"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:14,211 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:14,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cd83f820a65a6f849b6c8d5fb76334ad, NAME => 'testtb-testConsecutiveExports,,1689487901418.cd83f820a65a6f849b6c8d5fb76334ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 61d4ef5e3e5d5ef3d3eeab65d4525d64, NAME => 'testtb-testConsecutiveExports,1,1689487901418.61d4ef5e3e5d5ef3d3eeab65d4525d64.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:14,211 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 06:12:14,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487934211"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:14,213 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 06:12:14,215 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:14,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-07-16 06:12:14,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 06:12:14,288 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 06:12:14,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 06:12:14,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 06:12:14,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 06:12:14,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 06:12:14,347 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 766), OpenFileDescriptor=905 (was 913), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 407) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3428 (was 2891) - AvailableMemoryMB LEAK? - 2023-07-16 06:12:14,347 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-16 06:12:14,372 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=182, AvailableMemoryMB=3424 2023-07-16 06:12:14,373 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-16 06:12:14,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:12:14,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:14,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:14,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 06:12:14,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:14,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:14,382 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,382 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,382 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 empty. 2023-07-16 06:12:14,383 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,383 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 empty. 2023-07-16 06:12:14,383 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,383 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 06:12:14,404 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:14,406 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 25aa5ec384141c4b6003557a59653064, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:14,407 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 42680463735b8afd60379cb7cef86712, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 25aa5ec384141c4b6003557a59653064, disabling compactions & flushes 2023-07-16 06:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. after waiting 0 ms 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 25aa5ec384141c4b6003557a59653064: 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 42680463735b8afd60379cb7cef86712, disabling compactions & flushes 2023-07-16 06:12:14,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. after waiting 0 ms 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 42680463735b8afd60379cb7cef86712: 2023-07-16 06:12:14,432 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:14,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487934433"}]},"ts":"1689487934433"} 2023-07-16 06:12:14,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487934433"}]},"ts":"1689487934433"} 2023-07-16 06:12:14,441 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:14,442 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:14,442 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487934442"}]},"ts":"1689487934442"} 2023-07-16 06:12:14,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 06:12:14,446 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:14,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:14,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:14,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:14,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:14,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, ASSIGN}] 2023-07-16 06:12:14,451 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, ASSIGN 2023-07-16 06:12:14,452 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, ASSIGN 2023-07-16 06:12:14,452 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43885,1689487858173; forceNewPlan=false, retain=false 2023-07-16 06:12:14,452 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:12:14,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:14,603 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:14,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=42680463735b8afd60379cb7cef86712, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:14,606 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=25aa5ec384141c4b6003557a59653064, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:14,607 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487934606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487934606"}]},"ts":"1689487934606"} 2023-07-16 06:12:14,607 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487934606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487934606"}]},"ts":"1689487934606"} 2023-07-16 06:12:14,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 42680463735b8afd60379cb7cef86712, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:12:14,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 25aa5ec384141c4b6003557a59653064, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:14,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:14,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42680463735b8afd60379cb7cef86712, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:14,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. service=AccessControlService 2023-07-16 06:12:14,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25aa5ec384141c4b6003557a59653064, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:14,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. service=AccessControlService 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:14,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,776 INFO [StoreOpener-25aa5ec384141c4b6003557a59653064-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,776 INFO [StoreOpener-42680463735b8afd60379cb7cef86712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,778 DEBUG [StoreOpener-25aa5ec384141c4b6003557a59653064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf 2023-07-16 06:12:14,778 DEBUG [StoreOpener-25aa5ec384141c4b6003557a59653064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf 2023-07-16 06:12:14,778 DEBUG [StoreOpener-42680463735b8afd60379cb7cef86712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf 2023-07-16 06:12:14,778 DEBUG [StoreOpener-42680463735b8afd60379cb7cef86712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf 2023-07-16 06:12:14,779 INFO [StoreOpener-25aa5ec384141c4b6003557a59653064-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25aa5ec384141c4b6003557a59653064 columnFamilyName cf 2023-07-16 06:12:14,779 INFO [StoreOpener-42680463735b8afd60379cb7cef86712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42680463735b8afd60379cb7cef86712 columnFamilyName cf 2023-07-16 06:12:14,780 INFO [StoreOpener-42680463735b8afd60379cb7cef86712-1] regionserver.HStore(310): Store=42680463735b8afd60379cb7cef86712/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:14,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,783 INFO [StoreOpener-25aa5ec384141c4b6003557a59653064-1] regionserver.HStore(310): Store=25aa5ec384141c4b6003557a59653064/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:14,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:14,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:14,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42680463735b8afd60379cb7cef86712; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58740496, jitterRate=-0.12469840049743652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:14,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42680463735b8afd60379cb7cef86712: 2023-07-16 06:12:14,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712., pid=60, masterSystemTime=1689487934764 2023-07-16 06:12:14,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=42680463735b8afd60379cb7cef86712, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:14,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487934792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487934792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487934792"}]},"ts":"1689487934792"} 2023-07-16 06:12:14,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 06:12:14,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 42680463735b8afd60379cb7cef86712, server=jenkins-hbase4.apache.org,33137,1689487858246 in 186 msec 2023-07-16 06:12:14,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:14,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, ASSIGN in 351 msec 2023-07-16 06:12:14,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:14,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25aa5ec384141c4b6003557a59653064; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67181610, jitterRate=0.0010839998722076416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:14,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25aa5ec384141c4b6003557a59653064: 2023-07-16 06:12:14,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064., pid=61, masterSystemTime=1689487934764 2023-07-16 06:12:14,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:14,809 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=25aa5ec384141c4b6003557a59653064, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:14,809 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487934809"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487934809"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487934809"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487934809"}]},"ts":"1689487934809"} 2023-07-16 06:12:14,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 06:12:14,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 25aa5ec384141c4b6003557a59653064, server=jenkins-hbase4.apache.org,43885,1689487858173 in 201 msec 2023-07-16 06:12:14,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-16 06:12:14,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, ASSIGN in 365 msec 2023-07-16 06:12:14,816 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:14,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487934816"}]},"ts":"1689487934816"} 2023-07-16 06:12:14,817 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 06:12:14,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:14,820 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 06:12:14,825 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:14,827 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,827 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,827 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,827 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:14,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:14,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:14,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:14,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:14,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 453 msec 2023-07-16 06:12:14,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:14,984 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 06:12:14,984 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-16 06:12:14,984 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:14,988 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-16 06:12:14,988 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:14,988 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-16 06:12:14,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487934991 (current time:1689487934991). 2023-07-16 06:12:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x04b40adb to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:14,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63fce87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:14,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:15,001 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:15,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04b40adb to 127.0.0.1:56819 2023-07-16 06:12:15,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:15,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x59fbde7c to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:15,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d3de54a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:15,028 DEBUG [hconnection-0x50e579c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:15,032 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:15,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59fbde7c to 127.0.0.1:56819 2023-07-16 06:12:15,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:15,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:15,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:15,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:15,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:15,042 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:15,043 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689488535043 2023-07-16 06:12:15,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:15,044 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:15,044 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:15,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:15,045 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:15,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-16 06:12:15,047 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:15,048 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689488535048 2023-07-16 06:12:15,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,063 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:15,063 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:15,069 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 06:12:15,069 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 06:12:15,070 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,070 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,071 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,071 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,071 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,071 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,072 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,072 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,075 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,075 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:15,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:15,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:15,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:15,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,091 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:15,091 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,092 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a73f04[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a73f04[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:15,096 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 06:12:15,097 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,098 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,098 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:15,099 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:15,099 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:15,099 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. started... 2023-07-16 06:12:15,099 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:15,099 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. started... 2023-07-16 06:12:15,099 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:15,101 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25aa5ec384141c4b6003557a59653064: 2023-07-16 06:12:15,099 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42680463735b8afd60379cb7cef86712: 2023-07-16 06:12:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,099 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:15,102 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:15,102 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:15,111 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:15,111 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:15,111 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:15,135 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. completed. 2023-07-16 06:12:15,135 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:15,136 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:15,140 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:15,140 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. completed. 2023-07-16 06:12:15,140 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:15,141 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:15,141 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:15,141 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,141 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:15,141 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,142 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,144 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:15,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:15,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,146 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:12:15,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 06:12:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:12:15,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 06:12:15,152 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 06:12:15,153 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:15,153 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:15,153 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,153 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,157 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:15,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,159 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:15,159 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,160 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,163 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,164 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,164 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,168 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,168 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,171 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,171 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,171 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:15,171 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:15,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,171 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:15,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:15,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:15,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,346 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:15,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:15,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:15,347 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:15,648 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:15,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:15,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:15,649 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:15,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 06:12:15,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,776 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689487935043Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487935173 (+130 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487935174 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487935216 (+42 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487935273 (+57 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689487935772 (+499 ms) 2023-07-16 06:12:15,779 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:15,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 735 msec 2023-07-16 06:12:16,149 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:16,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:16,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:16,162 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,163 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:16,163 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:16,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487936175 (current time:1689487936175). 2023-07-16 06:12:16,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:16,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x59958c2e to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:16,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3260898f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:16,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:16,188 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:16,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59958c2e to 127.0.0.1:56819 2023-07-16 06:12:16,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:16,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x0df138d6 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78f031ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:16,303 DEBUG [hconnection-0x4e6af3da-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:16,307 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:16,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df138d6 to 127.0.0.1:56819 2023-07-16 06:12:16,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:16,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:16,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:16,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,318 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,319 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689488536319 2023-07-16 06:12:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,320 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:16,320 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:16,321 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-16 06:12:16,324 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,324 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689488536324 2023-07-16 06:12:16,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,339 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:16,339 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,340 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 06:12:16,340 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 06:12:16,418 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,418 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,420 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:16,422 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,422 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:16,422 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,422 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,423 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,423 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,427 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,427 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,428 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,430 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,430 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,431 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,431 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,431 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,431 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,431 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,432 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,432 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,433 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87f477[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:16,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87f477[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:16,441 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 06:12:16,441 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,444 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,444 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:16,444 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,444 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,445 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,445 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,445 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:16,446 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,446 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,446 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:16,450 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:16,450 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:16,458 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:16,458 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:16,459 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. started... 2023-07-16 06:12:16,458 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. started... 2023-07-16 06:12:16,459 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 25aa5ec384141c4b6003557a59653064 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 06:12:16,459 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42680463735b8afd60379cb7cef86712 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 06:12:16,482 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/.tmp/cf/62d3eb745d4f45488dca12df1e46c333 2023-07-16 06:12:16,482 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/.tmp/cf/4187dd9c3c0b45089261428adedb49bf 2023-07-16 06:12:16,489 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/.tmp/cf/62d3eb745d4f45488dca12df1e46c333 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333 2023-07-16 06:12:16,489 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/.tmp/cf/4187dd9c3c0b45089261428adedb49bf as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf 2023-07-16 06:12:16,498 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 06:12:16,499 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 25aa5ec384141c4b6003557a59653064 in 40ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:16,499 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:16,500 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25aa5ec384141c4b6003557a59653064: 2023-07-16 06:12:16,500 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,500 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:16,500 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333] hfiles 2023-07-16 06:12:16,500 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,501 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 06:12:16,503 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 42680463735b8afd60379cb7cef86712 in 44ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:16,506 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42680463735b8afd60379cb7cef86712: 2023-07-16 06:12:16,507 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,507 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:16,507 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf] hfiles 2023-07-16 06:12:16,507 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,535 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. completed. 2023-07-16 06:12:16,535 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:16,535 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:16,535 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:16,535 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,535 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,535 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:16,537 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,537 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,537 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,537 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,545 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. completed. 2023-07-16 06:12:16,545 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:16,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,545 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:16,545 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:16,545 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,545 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,545 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:16,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,547 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,547 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,547 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,547 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:12:16,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 06:12:16,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:12:16,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 06:12:16,558 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 06:12:16,558 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:16,558 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:16,558 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,558 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:16,564 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,564 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,565 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,565 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,569 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,569 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,570 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,572 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,573 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,573 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,577 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,578 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:16,579 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,579 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:16,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,587 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:16,587 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,587 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:16,624 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:16,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 06:12:16,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,736 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689487936319Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689487936587 (+268 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689487936587Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689487936607 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689487936637 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689487936736 (+99 ms) 2023-07-16 06:12:16,740 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 420 msec 2023-07-16 06:12:16,924 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:16,962 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:16,969 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:16,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:16,972 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:16,978 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:16,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39467] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:16,978 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:16,981 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:16,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43885] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:16,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:12:16,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:16,987 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:16,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 06:12:16,987 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:16,992 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:16,992 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:16,992 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 empty. 2023-07-16 06:12:16,993 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 empty. 2023-07-16 06:12:16,993 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:16,993 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:16,993 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 06:12:17,006 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:17,011 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2c6fb9db07ca28ce5f2291af32132f64, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:17,018 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => a55deaf6487540e2d89565744e9e1a53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2c6fb9db07ca28ce5f2291af32132f64, disabling compactions & flushes 2023-07-16 06:12:17,047 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. after waiting 0 ms 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,047 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2c6fb9db07ca28ce5f2291af32132f64: 2023-07-16 06:12:17,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:17,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing a55deaf6487540e2d89565744e9e1a53, disabling compactions & flushes 2023-07-16 06:12:17,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. after waiting 0 ms 2023-07-16 06:12:17,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,050 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for a55deaf6487540e2d89565744e9e1a53: 2023-07-16 06:12:17,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:17,056 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487937056"}]},"ts":"1689487937056"} 2023-07-16 06:12:17,056 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487937056"}]},"ts":"1689487937056"} 2023-07-16 06:12:17,058 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:17,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:17,059 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487937059"}]},"ts":"1689487937059"} 2023-07-16 06:12:17,061 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 06:12:17,070 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:17,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:17,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:17,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:17,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:17,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, ASSIGN}] 2023-07-16 06:12:17,076 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, ASSIGN 2023-07-16 06:12:17,076 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, ASSIGN 2023-07-16 06:12:17,077 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43885,1689487858173; forceNewPlan=false, retain=false 2023-07-16 06:12:17,078 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39467,1689487858304; forceNewPlan=false, retain=false 2023-07-16 06:12:17,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:17,229 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:17,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a55deaf6487540e2d89565744e9e1a53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:17,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2c6fb9db07ca28ce5f2291af32132f64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:17,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487937233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487937233"}]},"ts":"1689487937233"} 2023-07-16 06:12:17,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487937233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487937233"}]},"ts":"1689487937233"} 2023-07-16 06:12:17,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure a55deaf6487540e2d89565744e9e1a53, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:17,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 2c6fb9db07ca28ce5f2291af32132f64, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:17,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:17,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a55deaf6487540e2d89565744e9e1a53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 06:12:17,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. service=AccessControlService 2023-07-16 06:12:17,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:17,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:17,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,395 INFO [StoreOpener-a55deaf6487540e2d89565744e9e1a53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c6fb9db07ca28ce5f2291af32132f64, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 06:12:17,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. service=AccessControlService 2023-07-16 06:12:17,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:17,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:17,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,406 INFO [StoreOpener-2c6fb9db07ca28ce5f2291af32132f64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,408 DEBUG [StoreOpener-2c6fb9db07ca28ce5f2291af32132f64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf 2023-07-16 06:12:17,408 DEBUG [StoreOpener-2c6fb9db07ca28ce5f2291af32132f64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf 2023-07-16 06:12:17,408 INFO [StoreOpener-2c6fb9db07ca28ce5f2291af32132f64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c6fb9db07ca28ce5f2291af32132f64 columnFamilyName cf 2023-07-16 06:12:17,409 INFO [StoreOpener-2c6fb9db07ca28ce5f2291af32132f64-1] regionserver.HStore(310): Store=2c6fb9db07ca28ce5f2291af32132f64/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:17,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,412 DEBUG [StoreOpener-a55deaf6487540e2d89565744e9e1a53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf 2023-07-16 06:12:17,412 DEBUG [StoreOpener-a55deaf6487540e2d89565744e9e1a53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf 2023-07-16 06:12:17,412 INFO [StoreOpener-a55deaf6487540e2d89565744e9e1a53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a55deaf6487540e2d89565744e9e1a53 columnFamilyName cf 2023-07-16 06:12:17,413 INFO [StoreOpener-a55deaf6487540e2d89565744e9e1a53-1] regionserver.HStore(310): Store=a55deaf6487540e2d89565744e9e1a53/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:17,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2c6fb9db07ca28ce5f2291af32132f64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71489438, jitterRate=0.065275639295578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:17,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2c6fb9db07ca28ce5f2291af32132f64: 2023-07-16 06:12:17,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64., pid=70, masterSystemTime=1689487937391 2023-07-16 06:12:17,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:17,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a55deaf6487540e2d89565744e9e1a53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67682707, jitterRate=0.00855092704296112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a55deaf6487540e2d89565744e9e1a53: 2023-07-16 06:12:17,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53., pid=69, masterSystemTime=1689487937387 2023-07-16 06:12:17,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2c6fb9db07ca28ce5f2291af32132f64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:17,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487937424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487937424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487937424"}]},"ts":"1689487937424"} 2023-07-16 06:12:17,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a55deaf6487540e2d89565744e9e1a53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:17,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487937426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487937426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487937426"}]},"ts":"1689487937426"} 2023-07-16 06:12:17,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-16 06:12:17,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 2c6fb9db07ca28ce5f2291af32132f64, server=jenkins-hbase4.apache.org,39467,1689487858304 in 188 msec 2023-07-16 06:12:17,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-16 06:12:17,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, ASSIGN in 358 msec 2023-07-16 06:12:17,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure a55deaf6487540e2d89565744e9e1a53, server=jenkins-hbase4.apache.org,43885,1689487858173 in 194 msec 2023-07-16 06:12:17,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 06:12:17,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, ASSIGN in 362 msec 2023-07-16 06:12:17,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:17,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487937440"}]},"ts":"1689487937440"} 2023-07-16 06:12:17,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 06:12:17,445 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:17,445 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 06:12:17,447 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 06:12:17,450 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:17,450 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:17,450 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:17,450 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:17,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,452 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,453 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:17,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 468 msec 2023-07-16 06:12:17,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:17,596 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 06:12:17,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53], force=true 2023-07-16 06:12:17,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53], force=true 2023-07-16 06:12:17,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53], force=true 2023-07-16 06:12:17,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53], force=true 2023-07-16 06:12:17,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:17,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, UNASSIGN}] 2023-07-16 06:12:17,721 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, UNASSIGN 2023-07-16 06:12:17,722 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2c6fb9db07ca28ce5f2291af32132f64, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:17,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487937722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487937722"}]},"ts":"1689487937722"} 2023-07-16 06:12:17,729 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, UNASSIGN 2023-07-16 06:12:17,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a55deaf6487540e2d89565744e9e1a53, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:17,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487937730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487937730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487937730"}]},"ts":"1689487937730"} 2023-07-16 06:12:17,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 2c6fb9db07ca28ce5f2291af32132f64, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:17,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure a55deaf6487540e2d89565744e9e1a53, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:17,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:17,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:17,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2c6fb9db07ca28ce5f2291af32132f64, disabling compactions & flushes 2023-07-16 06:12:17,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. after waiting 0 ms 2023-07-16 06:12:17,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:17,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2c6fb9db07ca28ce5f2291af32132f64 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 06:12:17,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:17,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a55deaf6487540e2d89565744e9e1a53, disabling compactions & flushes 2023-07-16 06:12:17,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. after waiting 0 ms 2023-07-16 06:12:17,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:17,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a55deaf6487540e2d89565744e9e1a53 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 06:12:17,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/.tmp/cf/97426c61b72145f580397b4713e75203 2023-07-16 06:12:17,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/.tmp/cf/da50b0b7c74b4110aa1a4b5a331ee208 2023-07-16 06:12:17,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/.tmp/cf/97426c61b72145f580397b4713e75203 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203 2023-07-16 06:12:17,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/.tmp/cf/da50b0b7c74b4110aa1a4b5a331ee208 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208 2023-07-16 06:12:17,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:17,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 06:12:17,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2c6fb9db07ca28ce5f2291af32132f64 in 88ms, sequenceid=5, compaction requested=false 2023-07-16 06:12:17,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 06:12:17,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 06:12:17,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a55deaf6487540e2d89565744e9e1a53 in 94ms, sequenceid=5, compaction requested=false 2023-07-16 06:12:18,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 06:12:18,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 06:12:18,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:18,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64. 2023-07-16 06:12:18,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2c6fb9db07ca28ce5f2291af32132f64: 2023-07-16 06:12:18,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:18,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53. 2023-07-16 06:12:18,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a55deaf6487540e2d89565744e9e1a53: 2023-07-16 06:12:18,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:18,017 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2c6fb9db07ca28ce5f2291af32132f64, regionState=CLOSED 2023-07-16 06:12:18,017 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487938017"}]},"ts":"1689487938017"} 2023-07-16 06:12:18,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:18,024 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a55deaf6487540e2d89565744e9e1a53, regionState=CLOSED 2023-07-16 06:12:18,024 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487938024"}]},"ts":"1689487938024"} 2023-07-16 06:12:18,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-16 06:12:18,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 2c6fb9db07ca28ce5f2291af32132f64, server=jenkins-hbase4.apache.org,39467,1689487858304 in 290 msec 2023-07-16 06:12:18,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-16 06:12:18,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure a55deaf6487540e2d89565744e9e1a53, server=jenkins-hbase4.apache.org,43885,1689487858173 in 294 msec 2023-07-16 06:12:18,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2c6fb9db07ca28ce5f2291af32132f64, UNASSIGN in 321 msec 2023-07-16 06:12:18,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-16 06:12:18,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a55deaf6487540e2d89565744e9e1a53, UNASSIGN in 316 msec 2023-07-16 06:12:18,166 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 06:12:18,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936983.2c6fb9db07ca28ce5f2291af32132f64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:18,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487936983.a55deaf6487540e2d89565744e9e1a53.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:18,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:18,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:18,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, ASSIGN}] 2023-07-16 06:12:18,268 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, ASSIGN 2023-07-16 06:12:18,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:18,273 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39467,1689487858304; forceNewPlan=false, retain=false 2023-07-16 06:12:18,423 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:12:18,425 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b3320c56f3d84c2caebda3d597af314a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487938425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487938425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487938425"}]},"ts":"1689487938425"} 2023-07-16 06:12:18,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b3320c56f3d84c2caebda3d597af314a, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:18,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:18,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3320c56f3d84c2caebda3d597af314a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:12:18,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. service=AccessControlService 2023-07-16 06:12:18,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/.regioninfo 2023-07-16 06:12:18,608 INFO [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,610 DEBUG [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf 2023-07-16 06:12:18,610 DEBUG [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf 2023-07-16 06:12:18,610 INFO [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3320c56f3d84c2caebda3d597af314a columnFamilyName cf 2023-07-16 06:12:18,694 DEBUG [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] regionserver.HStore(539): loaded hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/97426c61b72145f580397b4713e75203.a55deaf6487540e2d89565744e9e1a53->hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203-top 2023-07-16 06:12:18,710 DEBUG [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] regionserver.HStore(539): loaded hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/da50b0b7c74b4110aa1a4b5a331ee208.2c6fb9db07ca28ce5f2291af32132f64->hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208-top 2023-07-16 06:12:18,711 INFO [StoreOpener-b3320c56f3d84c2caebda3d597af314a-1] regionserver.HStore(310): Store=b3320c56f3d84c2caebda3d597af314a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:18,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:18,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b3320c56f3d84c2caebda3d597af314a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67293090, jitterRate=0.0027451813220977783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b3320c56f3d84c2caebda3d597af314a: 2023-07-16 06:12:18,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a., pid=77, masterSystemTime=1689487938580 2023-07-16 06:12:18,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.,because compaction is disabled. 2023-07-16 06:12:18,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:18,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:18,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b3320c56f3d84c2caebda3d597af314a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487938744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487938744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487938744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487938744"}]},"ts":"1689487938744"} 2023-07-16 06:12:18,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 06:12:18,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b3320c56f3d84c2caebda3d597af314a, server=jenkins-hbase4.apache.org,39467,1689487858304 in 322 msec 2023-07-16 06:12:18,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 06:12:18,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, ASSIGN in 484 msec 2023-07-16 06:12:18,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2c6fb9db07ca28ce5f2291af32132f64, a55deaf6487540e2d89565744e9e1a53], force=true in 1.1020 sec 2023-07-16 06:12:18,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:18,774 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 06:12:18,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:18,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487938775 (current time:1689487938775). 2023-07-16 06:12:18,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:18,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x4d31cbbb to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:18,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b769c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:18,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:18,802 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:18,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d31cbbb to 127.0.0.1:56819 2023-07-16 06:12:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x37e9f146 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:18,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74469813, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:18,823 DEBUG [hconnection-0x39f20e3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:18,829 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:18,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37e9f146 to 127.0.0.1:56819 2023-07-16 06:12:18,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:18,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 06:12:18,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:18,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:18,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:18,848 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:18,849 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689488538849 2023-07-16 06:12:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:18,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,859 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:18,859 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:18,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:18,866 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:18,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 22 msec 2023-07-16 06:12:18,869 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:18,870 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689488538870 2023-07-16 06:12:18,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,911 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 06:12:18,911 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:18,913 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 06:12:18,913 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 06:12:18,914 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,914 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,916 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:18,916 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:18,916 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:18,916 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:18,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:18,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,918 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:18,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:18,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:18,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:18,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:18,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,926 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,927 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,931 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:18,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 06:12:18,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516b309[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:18,934 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 06:12:18,934 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:18,936 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:18,937 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:18,937 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:18,938 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:18,938 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:18,938 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:18,938 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:18,938 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. started... 2023-07-16 06:12:18,940 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3320c56f3d84c2caebda3d597af314a: 2023-07-16 06:12:18,940 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,940 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:18,940 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/97426c61b72145f580397b4713e75203.a55deaf6487540e2d89565744e9e1a53->hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203-top, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/da50b0b7c74b4110aa1a4b5a331ee208.2c6fb9db07ca28ce5f2291af32132f64->hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208-top] hfiles 2023-07-16 06:12:18,940 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/97426c61b72145f580397b4713e75203.a55deaf6487540e2d89565744e9e1a53 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,940 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:18,940 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:18,951 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/da50b0b7c74b4110aa1a4b5a331ee208.2c6fb9db07ca28ce5f2291af32132f64 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:18,959 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:18,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:18,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:18,961 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:19,067 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. completed. 2023-07-16 06:12:19,067 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:19,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:19,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:19,169 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:19,215 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,215 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:19,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:19,216 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:19,216 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:12:19,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 06:12:19,222 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 06:12:19,222 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:19,222 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:19,222 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,222 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:19,261 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,261 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,261 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,261 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,261 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,262 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,263 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,264 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,266 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,266 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:19,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,267 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,292 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:19,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:19,292 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:19,293 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:19,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:19,294 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,294 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,293 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:19,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:19,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:19,294 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:19,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:19,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:19,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:19,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:19,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-16 06:12:19,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,469 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:19,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:19,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:19,470 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:19,670 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:12:19,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 06:12:19,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,850 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689487938851Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487939293 (+442 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487939293Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487939298 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487939343 (+45 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689487939849 (+506 ms) 2023-07-16 06:12:19,853 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:19,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 997 msec 2023-07-16 06:12:19,971 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:19,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:19,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:19,972 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972 2023-07-16 06:12:19,972 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33329, tgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972, rawTgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:19,994 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:19,994 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-458999976_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:19,994 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 06:12:20,004 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,022 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,022 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,022 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,023 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,024 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,092 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-8388178916025610126.jar 2023-07-16 06:12:20,092 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,093 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,093 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,093 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,094 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,094 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:20,094 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:20,095 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:20,095 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:20,095 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:20,096 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:20,096 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:20,097 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:20,097 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:20,097 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:20,098 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:20,098 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:20,098 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:20,099 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:20,099 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:20,099 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:20,099 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:20,100 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:21,385 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:21,388 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 06:12:21,390 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 06:12:21,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:21,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:22,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:28,207 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:30,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:36,665 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:36,670 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:36,679 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,679 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:36,680 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:36,680 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,680 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 06:12:36,680 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 06:12:36,680 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,681 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 06:12:36,681 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487939972/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 06:12:36,687 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:36,692 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487956692"}]},"ts":"1689487956692"} 2023-07-16 06:12:36,693 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 06:12:36,695 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 06:12:36,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, UNASSIGN}] 2023-07-16 06:12:36,697 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, UNASSIGN 2023-07-16 06:12:36,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b3320c56f3d84c2caebda3d597af314a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:36,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487956697"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487956697"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487956697"}]},"ts":"1689487956697"} 2023-07-16 06:12:36,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b3320c56f3d84c2caebda3d597af314a, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:36,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:36,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b3320c56f3d84c2caebda3d597af314a, disabling compactions & flushes 2023-07-16 06:12:36,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:36,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:36,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. after waiting 0 ms 2023-07-16 06:12:36,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:36,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 06:12:36,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:36,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a. 2023-07-16 06:12:36,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b3320c56f3d84c2caebda3d597af314a: 2023-07-16 06:12:36,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:36,893 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b3320c56f3d84c2caebda3d597af314a, regionState=CLOSED 2023-07-16 06:12:36,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487956893"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487956893"}]},"ts":"1689487956893"} 2023-07-16 06:12:36,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 06:12:36,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b3320c56f3d84c2caebda3d597af314a, server=jenkins-hbase4.apache.org,39467,1689487858304 in 196 msec 2023-07-16 06:12:36,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 06:12:36,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b3320c56f3d84c2caebda3d597af314a, UNASSIGN in 202 msec 2023-07-16 06:12:36,899 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487956899"}]},"ts":"1689487956899"} 2023-07-16 06:12:36,900 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 06:12:36,904 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 06:12:36,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 216 msec 2023-07-16 06:12:36,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:36,994 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 06:12:36,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,000 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,002 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,005 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,005 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,005 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,005 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,007 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,008 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 06:12:37,008 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:12:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 06:12:37,019 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:37,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:37,019 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:37,025 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/recovered.edits] 2023-07-16 06:12:37,026 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/recovered.edits] 2023-07-16 06:12:37,038 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/cf/97426c61b72145f580397b4713e75203 2023-07-16 06:12:37,041 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/recovered.edits/8.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53/recovered.edits/8.seqid 2023-07-16 06:12:37,042 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:37,043 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/recovered.edits] 2023-07-16 06:12:37,054 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/cf/da50b0b7c74b4110aa1a4b5a331ee208 2023-07-16 06:12:37,055 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/97426c61b72145f580397b4713e75203.a55deaf6487540e2d89565744e9e1a53 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/97426c61b72145f580397b4713e75203.a55deaf6487540e2d89565744e9e1a53 2023-07-16 06:12:37,058 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/da50b0b7c74b4110aa1a4b5a331ee208.2c6fb9db07ca28ce5f2291af32132f64 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/cf/da50b0b7c74b4110aa1a4b5a331ee208.2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:37,058 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/recovered.edits/8.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64/recovered.edits/8.seqid 2023-07-16 06:12:37,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2c6fb9db07ca28ce5f2291af32132f64 2023-07-16 06:12:37,063 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/recovered.edits/12.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a/recovered.edits/12.seqid 2023-07-16 06:12:37,064 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b3320c56f3d84c2caebda3d597af314a 2023-07-16 06:12:37,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 06:12:37,069 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,077 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 06:12:37,080 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 06:12:37,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 06:12:37,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957081"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 06:12:37,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b3320c56f3d84c2caebda3d597af314a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487936984.b3320c56f3d84c2caebda3d597af314a.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 06:12:37,083 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 06:12:37,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487957083"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,092 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 06:12:37,096 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 100 msec 2023-07-16 06:12:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 06:12:37,111 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 06:12:37,112 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,118 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957118"}]},"ts":"1689487957118"} 2023-07-16 06:12:37,120 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 06:12:37,122 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 06:12:37,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, UNASSIGN}] 2023-07-16 06:12:37,126 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, UNASSIGN 2023-07-16 06:12:37,126 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, UNASSIGN 2023-07-16 06:12:37,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=25aa5ec384141c4b6003557a59653064, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:37,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=42680463735b8afd60379cb7cef86712, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:37,128 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957128"}]},"ts":"1689487957128"} 2023-07-16 06:12:37,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957128"}]},"ts":"1689487957128"} 2023-07-16 06:12:37,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 25aa5ec384141c4b6003557a59653064, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:37,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 42680463735b8afd60379cb7cef86712, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:12:37,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25aa5ec384141c4b6003557a59653064, disabling compactions & flushes 2023-07-16 06:12:37,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. after waiting 0 ms 2023-07-16 06:12:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:37,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:37,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42680463735b8afd60379cb7cef86712, disabling compactions & flushes 2023-07-16 06:12:37,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:37,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:37,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. after waiting 0 ms 2023-07-16 06:12:37,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:37,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:37,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:37,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:37,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712. 2023-07-16 06:12:37,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42680463735b8afd60379cb7cef86712: 2023-07-16 06:12:37,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:37,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064. 2023-07-16 06:12:37,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25aa5ec384141c4b6003557a59653064: 2023-07-16 06:12:37,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42680463735b8afd60379cb7cef86712 2023-07-16 06:12:37,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=42680463735b8afd60379cb7cef86712, regionState=CLOSED 2023-07-16 06:12:37,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957321"}]},"ts":"1689487957321"} 2023-07-16 06:12:37,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:37,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=25aa5ec384141c4b6003557a59653064, regionState=CLOSED 2023-07-16 06:12:37,325 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957325"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957325"}]},"ts":"1689487957325"} 2023-07-16 06:12:37,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-16 06:12:37,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 42680463735b8afd60379cb7cef86712, server=jenkins-hbase4.apache.org,33137,1689487858246 in 191 msec 2023-07-16 06:12:37,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42680463735b8afd60379cb7cef86712, UNASSIGN in 204 msec 2023-07-16 06:12:37,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-16 06:12:37,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 25aa5ec384141c4b6003557a59653064, server=jenkins-hbase4.apache.org,43885,1689487858173 in 197 msec 2023-07-16 06:12:37,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-16 06:12:37,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25aa5ec384141c4b6003557a59653064, UNASSIGN in 208 msec 2023-07-16 06:12:37,333 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957333"}]},"ts":"1689487957333"} 2023-07-16 06:12:37,334 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 06:12:37,336 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 06:12:37,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 225 msec 2023-07-16 06:12:37,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,421 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 06:12:37,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,426 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,428 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,433 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,433 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,433 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,435 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,435 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:37,435 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:37,437 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,437 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,437 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,437 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-16 06:12:37,437 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,437 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:12:37,438 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/recovered.edits] 2023-07-16 06:12:37,438 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/recovered.edits] 2023-07-16 06:12:37,438 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,439 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 06:12:37,448 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/cf/62d3eb745d4f45488dca12df1e46c333 2023-07-16 06:12:37,448 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/cf/4187dd9c3c0b45089261428adedb49bf 2023-07-16 06:12:37,452 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064/recovered.edits/9.seqid 2023-07-16 06:12:37,452 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712/recovered.edits/9.seqid 2023-07-16 06:12:37,452 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25aa5ec384141c4b6003557a59653064 2023-07-16 06:12:37,452 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42680463735b8afd60379cb7cef86712 2023-07-16 06:12:37,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 06:12:37,456 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,459 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 06:12:37,464 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 06:12:37,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 06:12:37,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957465"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957465"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:37,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25aa5ec384141c4b6003557a59653064, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487934374.25aa5ec384141c4b6003557a59653064.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 42680463735b8afd60379cb7cef86712, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487934374.42680463735b8afd60379cb7cef86712.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:37,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 06:12:37,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487957467"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,469 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 06:12:37,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 52 msec 2023-07-16 06:12:37,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 06:12:37,542 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 06:12:37,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 06:12:37,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 06:12:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 06:12:37,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,613 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 749) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:41410 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:44160 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:49850 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1371933458_1 at /127.0.0.1:44122 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4061 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:41625 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=557 (was 446) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2785 (was 3424) 2023-07-16 06:12:37,614 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-16 06:12:37,646 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=557, ProcessCount=182, AvailableMemoryMB=2766 2023-07-16 06:12:37,646 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-16 06:12:37,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:12:37,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:37,652 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:37,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 06:12:37,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:37,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:37,657 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:37,657 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:37,658 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 empty. 2023-07-16 06:12:37,658 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 empty. 2023-07-16 06:12:37,658 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:37,658 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:37,658 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 06:12:37,707 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:37,710 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7b5a2ff279589045d602ee158660f17, NAME => 'testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:37,711 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7fe465f4e7c31ad91082f3b9e02e3c74, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a7b5a2ff279589045d602ee158660f17, disabling compactions & flushes 2023-07-16 06:12:37,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. after waiting 0 ms 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:37,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:37,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a7b5a2ff279589045d602ee158660f17: 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7fe465f4e7c31ad91082f3b9e02e3c74, disabling compactions & flushes 2023-07-16 06:12:37,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. after waiting 0 ms 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:37,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:37,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7fe465f4e7c31ad91082f3b9e02e3c74: 2023-07-16 06:12:37,744 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:37,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487957745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957745"}]},"ts":"1689487957745"} 2023-07-16 06:12:37,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487957745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957745"}]},"ts":"1689487957745"} 2023-07-16 06:12:37,747 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:37,748 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:37,748 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957748"}]},"ts":"1689487957748"} 2023-07-16 06:12:37,749 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 06:12:37,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:37,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:37,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:37,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:37,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:37,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:37,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, ASSIGN}] 2023-07-16 06:12:37,759 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, ASSIGN 2023-07-16 06:12:37,759 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, ASSIGN 2023-07-16 06:12:37,760 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43885,1689487858173; forceNewPlan=false, retain=false 2023-07-16 06:12:37,760 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39467,1689487858304; forceNewPlan=false, retain=false 2023-07-16 06:12:37,910 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:37,913 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a7b5a2ff279589045d602ee158660f17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:37,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7fe465f4e7c31ad91082f3b9e02e3c74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:37,914 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487957913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957913"}]},"ts":"1689487957913"} 2023-07-16 06:12:37,914 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487957913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957913"}]},"ts":"1689487957913"} 2023-07-16 06:12:37,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 7fe465f4e7c31ad91082f3b9e02e3c74, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:37,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure a7b5a2ff279589045d602ee158660f17, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:37,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7b5a2ff279589045d602ee158660f17, NAME => 'testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. service=AccessControlService 2023-07-16 06:12:38,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7fe465f4e7c31ad91082f3b9e02e3c74, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:38,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. service=AccessControlService 2023-07-16 06:12:38,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:38,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:38,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,081 INFO [StoreOpener-a7b5a2ff279589045d602ee158660f17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,083 INFO [StoreOpener-7fe465f4e7c31ad91082f3b9e02e3c74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,083 DEBUG [StoreOpener-a7b5a2ff279589045d602ee158660f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf 2023-07-16 06:12:38,084 DEBUG [StoreOpener-a7b5a2ff279589045d602ee158660f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf 2023-07-16 06:12:38,084 INFO [StoreOpener-a7b5a2ff279589045d602ee158660f17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7b5a2ff279589045d602ee158660f17 columnFamilyName cf 2023-07-16 06:12:38,085 INFO [StoreOpener-a7b5a2ff279589045d602ee158660f17-1] regionserver.HStore(310): Store=a7b5a2ff279589045d602ee158660f17/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:38,086 DEBUG [StoreOpener-7fe465f4e7c31ad91082f3b9e02e3c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf 2023-07-16 06:12:38,086 DEBUG [StoreOpener-7fe465f4e7c31ad91082f3b9e02e3c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf 2023-07-16 06:12:38,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,088 INFO [StoreOpener-7fe465f4e7c31ad91082f3b9e02e3c74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fe465f4e7c31ad91082f3b9e02e3c74 columnFamilyName cf 2023-07-16 06:12:38,089 INFO [StoreOpener-7fe465f4e7c31ad91082f3b9e02e3c74-1] regionserver.HStore(310): Store=7fe465f4e7c31ad91082f3b9e02e3c74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:38,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:38,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:38,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:38,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7b5a2ff279589045d602ee158660f17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73249007, jitterRate=0.09149526059627533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7b5a2ff279589045d602ee158660f17: 2023-07-16 06:12:38,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7fe465f4e7c31ad91082f3b9e02e3c74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69350826, jitterRate=0.03340783715248108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:38,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7fe465f4e7c31ad91082f3b9e02e3c74: 2023-07-16 06:12:38,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17., pid=94, masterSystemTime=1689487958073 2023-07-16 06:12:38,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74., pid=93, masterSystemTime=1689487958073 2023-07-16 06:12:38,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,124 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a7b5a2ff279589045d602ee158660f17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,124 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487958124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487958124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487958124"}]},"ts":"1689487958124"} 2023-07-16 06:12:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7fe465f4e7c31ad91082f3b9e02e3c74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,125 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487958125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487958125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487958125"}]},"ts":"1689487958125"} 2023-07-16 06:12:38,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-16 06:12:38,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure a7b5a2ff279589045d602ee158660f17, server=jenkins-hbase4.apache.org,39467,1689487858304 in 205 msec 2023-07-16 06:12:38,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-16 06:12:38,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 7fe465f4e7c31ad91082f3b9e02e3c74, server=jenkins-hbase4.apache.org,43885,1689487858173 in 207 msec 2023-07-16 06:12:38,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, ASSIGN in 372 msec 2023-07-16 06:12:38,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-16 06:12:38,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, ASSIGN in 373 msec 2023-07-16 06:12:38,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:38,132 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487958132"}]},"ts":"1689487958132"} 2023-07-16 06:12:38,133 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 06:12:38,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:38,136 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 06:12:38,138 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:38,139 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:38,139 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:38,140 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:38,140 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:38,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:38,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:38,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:38,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:38,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 493 msec 2023-07-16 06:12:38,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,259 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 06:12:38,259 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 06:12:38,260 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:38,264 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 06:12:38,264 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:38,264 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-16 06:12:38,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487958267 (current time:1689487958267). 2023-07-16 06:12:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x1c50ce38 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e78f7b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:38,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:38,292 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:38,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c50ce38 to 127.0.0.1:56819 2023-07-16 06:12:38,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:38,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x66441289 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:38,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7f3177, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:38,315 DEBUG [hconnection-0x25e3ac1b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:38,316 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66441289 to 127.0.0.1:56819 2023-07-16 06:12:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,333 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,333 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488558333 2023-07-16 06:12:38,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:38,335 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:38,335 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:38,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:38,337 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 06:12:38,342 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:38,343 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488558343 2023-07-16 06:12:38,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,378 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 06:12:38,378 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,379 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 06:12:38,379 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:12:38,380 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,380 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,386 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,386 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,386 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,386 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,387 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,387 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,387 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,387 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,394 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,394 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,394 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,396 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,397 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,397 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,397 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,397 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,397 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,397 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,398 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,398 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,402 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,402 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:38,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:38,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:38,408 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:12:38,408 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,410 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,410 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:38,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,411 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,411 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,412 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,412 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,417 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,417 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:38,419 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,419 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. started... 2023-07-16 06:12:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:38,426 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:38,424 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,424 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b5a2ff279589045d602ee158660f17: 2023-07-16 06:12:38,427 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. started... 2023-07-16 06:12:38,427 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7fe465f4e7c31ad91082f3b9e02e3c74: 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:38,429 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:38,435 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:38,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:38,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:38,437 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:38,452 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. completed. 2023-07-16 06:12:38,452 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,452 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:38,452 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:38,452 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. completed. 2023-07-16 06:12:38,453 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,452 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:38,456 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,456 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,456 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,456 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,459 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:12:38,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:12:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:12:38,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:12:38,473 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 06:12:38,473 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:38,473 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:38,473 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,473 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,475 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,478 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,479 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,479 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,485 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,485 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,485 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,492 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,492 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,492 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,494 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,495 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,495 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,495 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 06:12:38,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,631 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689487958334Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689487958494 (+160 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689487958494Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689487958502 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689487958532 (+30 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689487958630 (+98 ms) 2023-07-16 06:12:38,634 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:38,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 300 msec 2023-07-16 06:12:38,637 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:38,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:38,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:38,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39467] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:38,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43885] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:38,661 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:38,661 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,661 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:38,690 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487958690 (current time:1689487958690). 2023-07-16 06:12:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x783129a9 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:38,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@408ac1c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:38,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:38,719 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:38,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x783129a9 to 127.0.0.1:56819 2023-07-16 06:12:38,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:38,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x3283ee11 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:38,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@438ef589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:38,729 DEBUG [hconnection-0x559cb8f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:38,732 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:38,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3283ee11 to 127.0.0.1:56819 2023-07-16 06:12:38,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:38,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,742 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,743 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488558743 2023-07-16 06:12:38,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:38,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:38,746 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:38,746 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:38,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:38,748 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:38,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 06:12:38,752 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:38,753 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488558753 2023-07-16 06:12:38,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,775 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 06:12:38,775 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,777 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 06:12:38,777 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:12:38,777 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,777 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,779 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,779 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,779 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,779 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,780 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,780 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,781 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,781 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,781 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,783 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:38,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:38,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:38,789 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:38,790 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:38,790 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:38,790 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,790 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,791 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,791 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,791 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,792 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:38,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:38,796 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:12:38,796 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,803 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,803 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,803 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. started... 2023-07-16 06:12:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:38,803 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:38,803 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7fe465f4e7c31ad91082f3b9e02e3c74 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 06:12:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:38,803 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,804 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. started... 2023-07-16 06:12:38,804 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7b5a2ff279589045d602ee158660f17 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 06:12:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,835 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/.tmp/cf/4f5e0b1135624a11b24bcae77b28eb14 2023-07-16 06:12:38,838 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/.tmp/cf/68087ede1f894839b6b75f9cdef80b24 2023-07-16 06:12:38,842 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/.tmp/cf/4f5e0b1135624a11b24bcae77b28eb14 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14 2023-07-16 06:12:38,844 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/.tmp/cf/68087ede1f894839b6b75f9cdef80b24 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24 2023-07-16 06:12:38,846 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:38,847 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:38,849 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 06:12:38,850 INFO [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 7fe465f4e7c31ad91082f3b9e02e3c74 in 47ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:38,850 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 06:12:38,850 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7fe465f4e7c31ad91082f3b9e02e3c74: 2023-07-16 06:12:38,851 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,851 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:38,851 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14] hfiles 2023-07-16 06:12:38,851 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,853 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 06:12:38,854 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a7b5a2ff279589045d602ee158660f17 in 50ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:38,856 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b5a2ff279589045d602ee158660f17: 2023-07-16 06:12:38,856 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,856 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:38,856 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24] hfiles 2023-07-16 06:12:38,856 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,875 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. completed. 2023-07-16 06:12:38,875 DEBUG [rs(jenkins-hbase4.apache.org,43885,1689487858173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:38,877 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,878 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,880 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. completed. 2023-07-16 06:12:38,880 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,881 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:38,881 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:38,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:38,886 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43885,1689487858173': 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:12:38,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:12:38,893 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 06:12:38,893 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:38,893 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:38,893 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,893 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:38,903 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:38,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,904 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,903 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:38,904 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,904 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,905 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,906 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,906 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,908 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,909 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,909 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:38,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,912 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:38,912 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,915 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:38,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:38,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:38,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,047 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:39,050 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:39,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 06:12:39,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,066 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689487958743Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689487958912 (+169 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689487958913 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689487958940 (+27 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689487958960 (+20 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689487959065 (+105 ms) 2023-07-16 06:12:39,074 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:39,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 329 msec 2023-07-16 06:12:39,350 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:39,351 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351 2023-07-16 06:12:39,352 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33329, tgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351, rawTgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:39,386 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:39,386 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-965737456_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,386 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 06:12:39,393 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,487 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,487 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,488 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,488 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,488 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,489 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,489 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,588 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-7933186537317931663.jar 2023-07-16 06:12:39,589 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,589 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,589 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,590 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,590 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,590 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:39,591 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:39,592 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:39,593 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:39,594 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:39,594 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:39,595 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:39,595 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:39,596 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:39,596 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:39,597 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:39,598 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:39,599 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:39,599 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:39,600 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:39,600 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:39,601 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:39,601 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:40,863 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:40,867 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 06:12:41,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:41,095 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:41,095 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:41,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:42,496 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:12:46,476 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:49,427 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:49,432 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:49,471 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:49,471 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:49,472 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:49,472 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:49,472 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 06:12:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 06:12:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 06:12:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487959351/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 06:12:49,481 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 06:12:49,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 06:12:49,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:49,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487969487"}]},"ts":"1689487969487"} 2023-07-16 06:12:49,489 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 06:12:49,492 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 06:12:49,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, UNASSIGN}] 2023-07-16 06:12:49,501 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, UNASSIGN 2023-07-16 06:12:49,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, UNASSIGN 2023-07-16 06:12:49,502 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a7b5a2ff279589045d602ee158660f17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:49,502 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487969502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487969502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487969502"}]},"ts":"1689487969502"} 2023-07-16 06:12:49,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7fe465f4e7c31ad91082f3b9e02e3c74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:49,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487969502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487969502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487969502"}]},"ts":"1689487969502"} 2023-07-16 06:12:49,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure a7b5a2ff279589045d602ee158660f17, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:49,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 7fe465f4e7c31ad91082f3b9e02e3c74, server=jenkins-hbase4.apache.org,43885,1689487858173}] 2023-07-16 06:12:49,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:49,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:49,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7b5a2ff279589045d602ee158660f17, disabling compactions & flushes 2023-07-16 06:12:49,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:49,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:49,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. after waiting 0 ms 2023-07-16 06:12:49,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:49,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:49,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7fe465f4e7c31ad91082f3b9e02e3c74, disabling compactions & flushes 2023-07-16 06:12:49,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:49,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:49,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. after waiting 0 ms 2023-07-16 06:12:49,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:49,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:49,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:49,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17. 2023-07-16 06:12:49,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7b5a2ff279589045d602ee158660f17: 2023-07-16 06:12:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:49,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:49,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74. 2023-07-16 06:12:49,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7fe465f4e7c31ad91082f3b9e02e3c74: 2023-07-16 06:12:49,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:49,782 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a7b5a2ff279589045d602ee158660f17, regionState=CLOSED 2023-07-16 06:12:49,783 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487969782"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487969782"}]},"ts":"1689487969782"} 2023-07-16 06:12:49,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:49,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7fe465f4e7c31ad91082f3b9e02e3c74, regionState=CLOSED 2023-07-16 06:12:49,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487969783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487969783"}]},"ts":"1689487969783"} 2023-07-16 06:12:49,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-16 06:12:49,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure a7b5a2ff279589045d602ee158660f17, server=jenkins-hbase4.apache.org,39467,1689487858304 in 275 msec 2023-07-16 06:12:49,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-16 06:12:49,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 7fe465f4e7c31ad91082f3b9e02e3c74, server=jenkins-hbase4.apache.org,43885,1689487858173 in 273 msec 2023-07-16 06:12:49,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7b5a2ff279589045d602ee158660f17, UNASSIGN in 289 msec 2023-07-16 06:12:49,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:49,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-16 06:12:49,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7fe465f4e7c31ad91082f3b9e02e3c74, UNASSIGN in 291 msec 2023-07-16 06:12:49,796 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487969796"}]},"ts":"1689487969796"} 2023-07-16 06:12:49,798 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 06:12:49,802 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 06:12:49,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 322 msec 2023-07-16 06:12:50,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:50,093 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 06:12:50,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,098 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,100 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,103 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:50,103 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:50,104 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,104 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,104 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,104 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:50,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:50,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:50,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:50,109 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/recovered.edits] 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,110 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 06:12:50,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/recovered.edits] 2023-07-16 06:12:50,131 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/cf/4f5e0b1135624a11b24bcae77b28eb14 2023-07-16 06:12:50,135 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/cf/68087ede1f894839b6b75f9cdef80b24 2023-07-16 06:12:50,138 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74/recovered.edits/9.seqid 2023-07-16 06:12:50,139 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7fe465f4e7c31ad91082f3b9e02e3c74 2023-07-16 06:12:50,140 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17/recovered.edits/9.seqid 2023-07-16 06:12:50,140 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7b5a2ff279589045d602ee158660f17 2023-07-16 06:12:50,141 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 06:12:50,151 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,184 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 06:12:50,195 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 06:12:50,199 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,199 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 06:12:50,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487970199"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:50,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487970199"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:50,203 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:50,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7b5a2ff279589045d602ee158660f17, NAME => 'testtb-testEmptyExportFileSystemState,,1689487957648.a7b5a2ff279589045d602ee158660f17.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7fe465f4e7c31ad91082f3b9e02e3c74, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487957648.7fe465f4e7c31ad91082f3b9e02e3c74.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:50,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 06:12:50,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487970203"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:50,206 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 06:12:50,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:50,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 115 msec 2023-07-16 06:12:50,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 06:12:50,213 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 06:12:50,228 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 06:12:50,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:50,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 06:12:50,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:50,287 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:39332 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-291757688_17 at /127.0.0.1:42870 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:40781 from appattempt_1689487866181_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:37817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:35419 from appattempt_1689487866181_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:42315 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-613927359_1 at /127.0.0.1:39318 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4713 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:51924 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-613927359_1 at /127.0.0.1:51918 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=601 (was 557) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=1768 (was 2766) 2023-07-16 06:12:50,288 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 06:12:50,316 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=601, ProcessCount=182, AvailableMemoryMB=1766 2023-07-16 06:12:50,316 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 06:12:50,318 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:12:50,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:50,322 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:50,322 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 06:12:50,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:50,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:50,333 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,333 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,334 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 empty. 2023-07-16 06:12:50,334 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc empty. 2023-07-16 06:12:50,336 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,336 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 06:12:50,358 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:50,360 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0a4dc71b2763c5c527064e92271e5cc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:50,360 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e91c8b305197bb738ba34b53fc997702, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp 2023-07-16 06:12:50,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e91c8b305197bb738ba34b53fc997702, disabling compactions & flushes 2023-07-16 06:12:50,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. after waiting 0 ms 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e91c8b305197bb738ba34b53fc997702: 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e0a4dc71b2763c5c527064e92271e5cc, disabling compactions & flushes 2023-07-16 06:12:50,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. after waiting 0 ms 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e0a4dc71b2763c5c527064e92271e5cc: 2023-07-16 06:12:50,414 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:50,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487970415"}]},"ts":"1689487970415"} 2023-07-16 06:12:50,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487970415"}]},"ts":"1689487970415"} 2023-07-16 06:12:50,421 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:50,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:50,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487970427"}]},"ts":"1689487970427"} 2023-07-16 06:12:50,430 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 06:12:50,433 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:50,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:50,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:50,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:50,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:50,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, ASSIGN}] 2023-07-16 06:12:50,438 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, ASSIGN 2023-07-16 06:12:50,439 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, ASSIGN 2023-07-16 06:12:50,439 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33137,1689487858246; forceNewPlan=false, retain=false 2023-07-16 06:12:50,439 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39467,1689487858304; forceNewPlan=false, retain=false 2023-07-16 06:12:50,590 INFO [jenkins-hbase4:39159] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:50,593 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e0a4dc71b2763c5c527064e92271e5cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:50,593 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e91c8b305197bb738ba34b53fc997702, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:50,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970593"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487970593"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487970593"}]},"ts":"1689487970593"} 2023-07-16 06:12:50,594 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970593"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487970593"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487970593"}]},"ts":"1689487970593"} 2023-07-16 06:12:50,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e0a4dc71b2763c5c527064e92271e5cc, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:12:50,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure e91c8b305197bb738ba34b53fc997702, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:12:50,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:50,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0a4dc71b2763c5c527064e92271e5cc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:50,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. service=AccessControlService 2023-07-16 06:12:50,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:50,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:50,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e91c8b305197bb738ba34b53fc997702, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:50,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. service=AccessControlService 2023-07-16 06:12:50,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:50,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:50,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,787 INFO [StoreOpener-e0a4dc71b2763c5c527064e92271e5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,791 INFO [StoreOpener-e91c8b305197bb738ba34b53fc997702-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,792 DEBUG [StoreOpener-e0a4dc71b2763c5c527064e92271e5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf 2023-07-16 06:12:50,792 DEBUG [StoreOpener-e0a4dc71b2763c5c527064e92271e5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf 2023-07-16 06:12:50,792 INFO [StoreOpener-e0a4dc71b2763c5c527064e92271e5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0a4dc71b2763c5c527064e92271e5cc columnFamilyName cf 2023-07-16 06:12:50,792 DEBUG [StoreOpener-e91c8b305197bb738ba34b53fc997702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf 2023-07-16 06:12:50,792 DEBUG [StoreOpener-e91c8b305197bb738ba34b53fc997702-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf 2023-07-16 06:12:50,793 INFO [StoreOpener-e91c8b305197bb738ba34b53fc997702-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e91c8b305197bb738ba34b53fc997702 columnFamilyName cf 2023-07-16 06:12:50,793 INFO [StoreOpener-e0a4dc71b2763c5c527064e92271e5cc-1] regionserver.HStore(310): Store=e0a4dc71b2763c5c527064e92271e5cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:50,793 INFO [StoreOpener-e91c8b305197bb738ba34b53fc997702-1] regionserver.HStore(310): Store=e91c8b305197bb738ba34b53fc997702/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:50,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:12:50,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e91c8b305197bb738ba34b53fc997702 2023-07-16 06:12:50,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:50,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:50,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0a4dc71b2763c5c527064e92271e5cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62006931, jitterRate=-0.07602472603321075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:50,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0a4dc71b2763c5c527064e92271e5cc: 2023-07-16 06:12:50,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e91c8b305197bb738ba34b53fc997702; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71119061, jitterRate=0.05975659191608429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:50,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e91c8b305197bb738ba34b53fc997702: 2023-07-16 06:12:50,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702., pid=109, masterSystemTime=1689487970748 2023-07-16 06:12:50,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc., pid=108, masterSystemTime=1689487970748 2023-07-16 06:12:50,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:50,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e91c8b305197bb738ba34b53fc997702, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:50,816 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487970816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487970816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487970816"}]},"ts":"1689487970816"} 2023-07-16 06:12:50,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:50,818 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e0a4dc71b2763c5c527064e92271e5cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:50,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487970818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487970818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487970818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487970818"}]},"ts":"1689487970818"} 2023-07-16 06:12:50,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-16 06:12:50,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure e91c8b305197bb738ba34b53fc997702, server=jenkins-hbase4.apache.org,33137,1689487858246 in 223 msec 2023-07-16 06:12:50,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-16 06:12:50,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e0a4dc71b2763c5c527064e92271e5cc, server=jenkins-hbase4.apache.org,39467,1689487858304 in 226 msec 2023-07-16 06:12:50,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, ASSIGN in 388 msec 2023-07-16 06:12:50,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-16 06:12:50,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, ASSIGN in 390 msec 2023-07-16 06:12:50,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:50,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487970827"}]},"ts":"1689487970827"} 2023-07-16 06:12:50,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 06:12:50,833 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:50,833 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 06:12:50,835 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:50,836 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,837 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,837 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,837 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:50,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:50,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:50,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:50,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:50,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 521 msec 2023-07-16 06:12:50,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:50,928 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 06:12:50,928 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-16 06:12:50,928 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:50,936 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-16 06:12:50,937 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:50,937 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-16 06:12:50,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487970955 (current time:1689487970955). 2023-07-16 06:12:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:50,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x493a8f9d to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:50,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1529018d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:50,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:50,979 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x493a8f9d to 127.0.0.1:56819 2023-07-16 06:12:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x0cd5b399 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:50,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@110e93f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:50,998 DEBUG [hconnection-0x4c76cd3c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:51,002 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:51,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cd5b399 to 127.0.0.1:56819 2023-07-16 06:12:51,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:51,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:51,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:51,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:51,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,015 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,018 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689488571018 2023-07-16 06:12:51,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:51,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,020 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:51,020 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:51,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:51,022 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-16 06:12:51,025 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:51,026 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689488571026 2023-07-16 06:12:51,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,056 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:51,056 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:51,058 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 06:12:51,058 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 06:12:51,114 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,114 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,116 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,116 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,117 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,120 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,120 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:51,121 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:51,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:51,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:51,123 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:51,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:51,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:51,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,145 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:51,145 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:51,145 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:51,145 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:51,145 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:51,154 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,154 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,154 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:51,154 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,155 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,155 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,155 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:51,156 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,156 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:51,156 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,156 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:51,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:51,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:51,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:51,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7f8ec2[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:51,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:51,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:51,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:51,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:51,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:51,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:51,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7f8ec2[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:51,167 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 06:12:51,167 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:51,169 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:51,169 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,169 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:51,170 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,170 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:51,172 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:51,172 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:51,172 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:51,176 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:51,178 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:51,178 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:51,178 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. started... 2023-07-16 06:12:51,178 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:51,178 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:51,178 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:51,178 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. started... 2023-07-16 06:12:51,179 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e91c8b305197bb738ba34b53fc997702: 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0a4dc71b2763c5c527064e92271e5cc: 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:51,182 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:51,252 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. completed. 2023-07-16 06:12:51,253 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:51,253 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:51,253 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:51,253 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,253 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:51,253 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:51,256 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,256 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:51,256 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,265 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. completed. 2023-07-16 06:12:51,265 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:51,265 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:51,265 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:51,265 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,265 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:51,265 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,268 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:51,268 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,268 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:51,268 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:51,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:51,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:12:51,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 06:12:51,276 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 06:12:51,276 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:51,276 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:51,276 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,276 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:51,278 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,278 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,279 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:51,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,279 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,279 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,280 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:51,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,281 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,301 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:51,302 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,307 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,310 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,311 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:51,324 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:51,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:51,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:51,325 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:51,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 06:12:51,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,405 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689487971018Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487971313 (+295 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487971313Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487971324 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487971347 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689487971404 (+57 ms) 2023-07-16 06:12:51,408 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:51,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 388 msec 2023-07-16 06:12:51,625 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:51,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:51,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:51,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39467] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:51,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33137] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:51,705 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,705 DEBUG [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:51,705 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:51,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:51,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487971734 (current time:1689487971734). 2023-07-16 06:12:51,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:51,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x78403c0a to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:51,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2250113, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:51,769 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78403c0a to 127.0.0.1:56819 2023-07-16 06:12:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(139): Connect 0x6286a4c7 to 127.0.0.1:56819 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:51,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b5f74f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:51,879 DEBUG [hconnection-0x3158d310-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:51,880 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6286a4c7 to 127.0.0.1:56819 2023-07-16 06:12:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:51,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,894 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,895 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689488571895 2023-07-16 06:12:51,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:51,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,897 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:51,897 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:51,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:51,904 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:51,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 13 msec 2023-07-16 06:12:51,910 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:51,911 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689488571911 2023-07-16 06:12:51,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,942 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:51,942 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:51,944 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 06:12:51,944 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 06:12:51,995 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,995 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,997 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,997 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,998 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,998 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:51,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,998 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:51,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,998 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:51,998 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:51,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:51,999 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:51,999 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:51,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:51,999 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:52,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,002 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:52,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,007 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:52,007 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:52,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,012 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:52,012 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:52,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,012 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43885,1689487858173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:52,017 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:52,017 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:52,017 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:52,018 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,019 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,019 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,020 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33137,1689487858246' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a81e27f[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:52,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39467,1689487858304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:52,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a81e27f[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:52,027 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 06:12:52,027 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:52,034 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,034 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,035 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:52,035 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:52,035 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43885,1689487858173' in zk 2023-07-16 06:12:52,036 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,036 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:52,036 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:52,037 DEBUG [member: 'jenkins-hbase4.apache.org,43885,1689487858173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:52,055 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:52,055 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:52,054 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:52,055 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:52,052 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:52,055 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. started... 2023-07-16 06:12:52,055 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. started... 2023-07-16 06:12:52,055 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0a4dc71b2763c5c527064e92271e5cc 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:12:52,055 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e91c8b305197bb738ba34b53fc997702 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:12:52,200 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:52,201 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/.tmp/cf/e2302fe1514d4e608bad30e3f0f6b092 2023-07-16 06:12:52,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:52,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:52,202 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:52,211 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/.tmp/cf/e2302fe1514d4e608bad30e3f0f6b092 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092 2023-07-16 06:12:52,219 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092, entries=47, sequenceid=6, filesize=8.0 K 2023-07-16 06:12:52,221 INFO [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e91c8b305197bb738ba34b53fc997702 in 166ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:52,221 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:52,222 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e91c8b305197bb738ba34b53fc997702: 2023-07-16 06:12:52,222 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,223 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:52,223 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092] hfiles 2023-07-16 06:12:52,223 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,223 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/.tmp/cf/f09fd6f85c404c4c9424618fa572bfee 2023-07-16 06:12:52,233 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/.tmp/cf/f09fd6f85c404c4c9424618fa572bfee as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee 2023-07-16 06:12:52,263 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 06:12:52,265 INFO [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e0a4dc71b2763c5c527064e92271e5cc in 210ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:52,275 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0a4dc71b2763c5c527064e92271e5cc: 2023-07-16 06:12:52,275 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,276 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:52,276 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee] hfiles 2023-07-16 06:12:52,276 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,370 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. completed. 2023-07-16 06:12:52,370 DEBUG [rs(jenkins-hbase4.apache.org,33137,1689487858246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:12:52,371 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:52,371 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:52,371 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,371 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:52,371 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33137,1689487858246' in zk 2023-07-16 06:12:52,373 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:52,373 DEBUG [member: 'jenkins-hbase4.apache.org,33137,1689487858246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:52,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:52,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33137,1689487858246': 2023-07-16 06:12:52,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33137,1689487858246' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 06:12:52,404 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. completed. 2023-07-16 06:12:52,404 DEBUG [rs(jenkins-hbase4.apache.org,39467,1689487858304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39467,1689487858304' in zk 2023-07-16 06:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:52,406 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39467,1689487858304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39467,1689487858304': 2023-07-16 06:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39467,1689487858304' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 06:12:52,413 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 06:12:52,413 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:52,413 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:52,413 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,413 INFO [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,416 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:52,417 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,417 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,418 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,419 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:52,420 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,420 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:52,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:52,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,423 DEBUG [(jenkins-hbase4.apache.org,39159,1689487856639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:52,423 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,424 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:12:52,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,426 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,502 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:52,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:52,507 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:52,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 06:12:52,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,528 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:52,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689487971895Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689487972424 (+529 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689487972426 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689487972430 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689487972460 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689487972527 (+67 ms) 2023-07-16 06:12:52,531 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:52,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 634 msec 2023-07-16 06:12:53,007 DEBUG [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:53,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:53,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:53,009 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009 2023-07-16 06:12:53,009 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33329, tgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009, rawTgtDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009, srcFsUri=hdfs://localhost:33329, srcDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:53,035 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c 2023-07-16 06:12:53,035 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_131093582_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:53,035 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33329, inputRoot=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c, snapshotDir=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 06:12:53,055 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:53,133 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,133 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,134 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,134 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,135 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,135 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,136 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,230 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/hadoop-2233390392386846115.jar 2023-07-16 06:12:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,232 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,232 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,233 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:53,235 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:53,235 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:53,236 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:53,236 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:53,236 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:53,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:53,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:53,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:53,238 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:53,238 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:53,238 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:53,239 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:53,239 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:53,239 DEBUG [Listener at jenkins-hbase4.apache.org/37817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:53,973 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:54,019 WARN [Listener at jenkins-hbase4.apache.org/37817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:54,023 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 06:12:54,026 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 06:12:54,173 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:54,175 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:54,961 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0007_000001 (auth:SIMPLE) 2023-07-16 06:12:55,342 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:12:59,902 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:02,237 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:06,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866181_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:08,321 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:13:08,321 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:13:08,331 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,331 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:13:08,331 INFO [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:13:08,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 06:13:08,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 06:13:08,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1289167179_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 06:13:08,333 DEBUG [Listener at jenkins-hbase4.apache.org/37817] snapshot.TestExportSnapshot(367): hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/export-test/export-1689487973009/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 06:13:08,338 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:08,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487988346"}]},"ts":"1689487988346"} 2023-07-16 06:13:08,350 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 06:13:08,352 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 06:13:08,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, UNASSIGN}] 2023-07-16 06:13:08,356 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, UNASSIGN 2023-07-16 06:13:08,356 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, UNASSIGN 2023-07-16 06:13:08,357 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e0a4dc71b2763c5c527064e92271e5cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:13:08,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e91c8b305197bb738ba34b53fc997702, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:13:08,357 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487988357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487988357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487988357"}]},"ts":"1689487988357"} 2023-07-16 06:13:08,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487988357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487988357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487988357"}]},"ts":"1689487988357"} 2023-07-16 06:13:08,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e0a4dc71b2763c5c527064e92271e5cc, server=jenkins-hbase4.apache.org,39467,1689487858304}] 2023-07-16 06:13:08,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure e91c8b305197bb738ba34b53fc997702, server=jenkins-hbase4.apache.org,33137,1689487858246}] 2023-07-16 06:13:08,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:08,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e91c8b305197bb738ba34b53fc997702 2023-07-16 06:13:08,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e91c8b305197bb738ba34b53fc997702, disabling compactions & flushes 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0a4dc71b2763c5c527064e92271e5cc, disabling compactions & flushes 2023-07-16 06:13:08,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. after waiting 0 ms 2023-07-16 06:13:08,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. after waiting 0 ms 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:13:08,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:13:08,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:08,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:08,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:08,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:08,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc. 2023-07-16 06:13:08,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0a4dc71b2763c5c527064e92271e5cc: 2023-07-16 06:13:08,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702. 2023-07-16 06:13:08,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e91c8b305197bb738ba34b53fc997702: 2023-07-16 06:13:08,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:13:08,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e0a4dc71b2763c5c527064e92271e5cc, regionState=CLOSED 2023-07-16 06:13:08,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487988562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487988562"}]},"ts":"1689487988562"} 2023-07-16 06:13:08,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e91c8b305197bb738ba34b53fc997702 2023-07-16 06:13:08,564 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e91c8b305197bb738ba34b53fc997702, regionState=CLOSED 2023-07-16 06:13:08,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487988564"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487988564"}]},"ts":"1689487988564"} 2023-07-16 06:13:08,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 06:13:08,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e0a4dc71b2763c5c527064e92271e5cc, server=jenkins-hbase4.apache.org,39467,1689487858304 in 206 msec 2023-07-16 06:13:08,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 06:13:08,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure e91c8b305197bb738ba34b53fc997702, server=jenkins-hbase4.apache.org,33137,1689487858246 in 209 msec 2023-07-16 06:13:08,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e0a4dc71b2763c5c527064e92271e5cc, UNASSIGN in 219 msec 2023-07-16 06:13:08,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 06:13:08,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e91c8b305197bb738ba34b53fc997702, UNASSIGN in 220 msec 2023-07-16 06:13:08,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487988576"}]},"ts":"1689487988576"} 2023-07-16 06:13:08,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 06:13:08,581 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 06:13:08,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 247 msec 2023-07-16 06:13:08,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:08,650 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 06:13:08,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,661 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,662 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33137] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,665 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:08,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:08,667 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 06:13:08,667 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:08,667 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,667 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:13:08,667 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:08,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 06:13:08,675 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:13:08,683 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:13:08,683 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/recovered.edits] 2023-07-16 06:13:08,686 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf, FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/recovered.edits] 2023-07-16 06:13:08,689 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/cf/f09fd6f85c404c4c9424618fa572bfee 2023-07-16 06:13:08,695 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc/recovered.edits/9.seqid 2023-07-16 06:13:08,695 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092 to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/cf/e2302fe1514d4e608bad30e3f0f6b092 2023-07-16 06:13:08,695 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e0a4dc71b2763c5c527064e92271e5cc 2023-07-16 06:13:08,700 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/recovered.edits/9.seqid to hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702/recovered.edits/9.seqid 2023-07-16 06:13:08,700 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e91c8b305197bb738ba34b53fc997702 2023-07-16 06:13:08,700 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 06:13:08,703 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,709 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 06:13:08,721 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 06:13:08,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 06:13:08,724 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487988723"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:08,724 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487988723"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:08,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:13:08,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e0a4dc71b2763c5c527064e92271e5cc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487970318.e0a4dc71b2763c5c527064e92271e5cc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e91c8b305197bb738ba34b53fc997702, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487970318.e91c8b305197bb738ba34b53fc997702.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:13:08,738 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 06:13:08,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487988738"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:08,748 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 06:13:08,759 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 108 msec 2023-07-16 06:13:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 06:13:08,769 INFO [Listener at jenkins-hbase4.apache.org/37817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 06:13:08,784 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 06:13:08,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 06:13:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39159] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:08,828 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 764) Potentially hanging thread: Thread-5321 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-470474881_1 at /127.0.0.1:38582 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:41048 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:38610 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:45519 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1289167179_17 at /127.0.0.1:33762 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ff4576f-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-470474881_1 at /127.0.0.1:33746 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=633 (was 601) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=1559 (was 1766) 2023-07-16 06:13:08,828 WARN [Listener at jenkins-hbase4.apache.org/37817] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-16 06:13:08,828 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 06:13:08,842 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:08,972 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689487866181_0007_01_000001 is : 143 2023-07-16 06:13:14,148 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:13:22,967 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:37,085 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:37,086 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:37,101 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 06:13:37,123 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 06:13:37,124 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:37,133 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:37,237 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:37,237 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 06:13:37,237 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 06:13:37,237 INFO [Listener at jenkins-hbase4.apache.org/37817] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 06:13:37,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33146fc9 to 127.0.0.1:56819 2023-07-16 06:13:37,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 06:13:37,237 DEBUG [Listener at jenkins-hbase4.apache.org/37817] util.JVMClusterUtil(257): Found active master hash=1157648882, stopped=false 2023-07-16 06:13:37,238 DEBUG [Listener at jenkins-hbase4.apache.org/37817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,238 DEBUG [Listener at jenkins-hbase4.apache.org/37817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 06:13:37,238 INFO [Listener at jenkins-hbase4.apache.org/37817] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:13:37,331 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:37,331 INFO [Listener at jenkins-hbase4.apache.org/37817] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 06:13:37,331 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:13:37,331 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:37,331 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:37,331 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:37,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b6ede4d to 127.0.0.1:56819 2023-07-16 06:13:37,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:37,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:37,332 DEBUG [Listener at jenkins-hbase4.apache.org/37817] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:37,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:37,332 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43885,1689487858173' ***** 2023-07-16 06:13:37,333 DEBUG [Listener at jenkins-hbase4.apache.org/37817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,333 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:37,333 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33137,1689487858246' ***** 2023-07-16 06:13:37,333 DEBUG [Listener at jenkins-hbase4.apache.org/37817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,333 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:37,333 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39467,1689487858304' ***** 2023-07-16 06:13:37,333 INFO [RS:0;jenkins-hbase4:43885] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:37,333 DEBUG [Listener at jenkins-hbase4.apache.org/37817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,333 INFO [RS:0;jenkins-hbase4:43885] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:37,333 INFO [RS:1;jenkins-hbase4:33137] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:37,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:37,333 INFO [RS:1;jenkins-hbase4:33137] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:37,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:37,333 INFO [RS:0;jenkins-hbase4:43885] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:37,333 INFO [Listener at jenkins-hbase4.apache.org/37817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:37,334 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:13:37,333 INFO [RS:1;jenkins-hbase4:33137] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:37,334 INFO [RS:2;jenkins-hbase4:39467] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:37,334 INFO [RS:2;jenkins-hbase4:39467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:37,334 INFO [RS:2;jenkins-hbase4:39467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:37,334 DEBUG [RS:0;jenkins-hbase4:43885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35b2d272 to 127.0.0.1:56819 2023-07-16 06:13:37,334 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:37,334 DEBUG [RS:0;jenkins-hbase4:43885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,334 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(3305): Received CLOSE for d448c541b979f07c15ea41012e66b28a 2023-07-16 06:13:37,334 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:13:37,336 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43885,1689487858173; all regions closed. 2023-07-16 06:13:37,336 DEBUG [RS:2;jenkins-hbase4:39467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x683b2496 to 127.0.0.1:56819 2023-07-16 06:13:37,336 DEBUG [RS:2;jenkins-hbase4:39467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,338 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39467,1689487858304; all regions closed. 2023-07-16 06:13:37,338 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(3305): Received CLOSE for de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:13:37,338 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:13:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d448c541b979f07c15ea41012e66b28a, disabling compactions & flushes 2023-07-16 06:13:37,339 DEBUG [RS:1;jenkins-hbase4:33137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7077879b to 127.0.0.1:56819 2023-07-16 06:13:37,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:13:37,339 DEBUG [RS:1;jenkins-hbase4:33137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:13:37,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. after waiting 0 ms 2023-07-16 06:13:37,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:13:37,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d448c541b979f07c15ea41012e66b28a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 06:13:37,341 INFO [RS:1;jenkins-hbase4:33137] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:37,341 INFO [RS:1;jenkins-hbase4:33137] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:37,341 INFO [RS:1;jenkins-hbase4:33137] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:37,341 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 06:13:37,341 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-16 06:13:37,341 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1478): Online Regions={d448c541b979f07c15ea41012e66b28a=hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a., 1588230740=hbase:meta,,1.1588230740, de10f23cf2984f34a4891a45eeea0cc4=hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4.} 2023-07-16 06:13:37,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 06:13:37,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 06:13:37,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 06:13:37,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 06:13:37,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 06:13:37,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 06:13:37,347 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1504): Waiting on 1588230740, d448c541b979f07c15ea41012e66b28a, de10f23cf2984f34a4891a45eeea0cc4 2023-07-16 06:13:37,372 DEBUG [RS:2;jenkins-hbase4:39467] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs 2023-07-16 06:13:37,372 DEBUG [RS:0;jenkins-hbase4:43885] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs 2023-07-16 06:13:37,372 INFO [RS:2;jenkins-hbase4:39467] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39467%2C1689487858304:(num 1689487860580) 2023-07-16 06:13:37,372 INFO [RS:0;jenkins-hbase4:43885] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43885%2C1689487858173:(num 1689487860579) 2023-07-16 06:13:37,372 DEBUG [RS:0;jenkins-hbase4:43885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,372 DEBUG [RS:2;jenkins-hbase4:39467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,372 INFO [RS:2;jenkins-hbase4:39467] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,372 INFO [RS:0;jenkins-hbase4:43885] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,372 INFO [RS:0;jenkins-hbase4:43885] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:37,379 INFO [RS:2;jenkins-hbase4:39467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:37,380 INFO [RS:2;jenkins-hbase4:39467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:37,380 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:37,380 INFO [RS:2;jenkins-hbase4:39467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:37,381 INFO [RS:2;jenkins-hbase4:39467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:37,381 INFO [RS:0;jenkins-hbase4:43885] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:37,381 INFO [RS:0;jenkins-hbase4:43885] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:37,381 INFO [RS:0;jenkins-hbase4:43885] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:37,381 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:37,382 INFO [RS:2;jenkins-hbase4:39467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39467 2023-07-16 06:13:37,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/.tmp/info/63de54bd8eb041bf9eacfc8503225a9d 2023-07-16 06:13:37,383 INFO [RS:0;jenkins-hbase4:43885] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43885 2023-07-16 06:13:37,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/info/adf4a7a65f524329a0cce6bcfeb10c70 2023-07-16 06:13:37,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/.tmp/info/63de54bd8eb041bf9eacfc8503225a9d as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/info/63de54bd8eb041bf9eacfc8503225a9d 2023-07-16 06:13:37,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/info/63de54bd8eb041bf9eacfc8503225a9d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 06:13:37,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adf4a7a65f524329a0cce6bcfeb10c70 2023-07-16 06:13:37,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d448c541b979f07c15ea41012e66b28a in 59ms, sequenceid=6, compaction requested=false 2023-07-16 06:13:37,402 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,404 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 06:13:37,404 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 06:13:37,416 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,420 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/namespace/d448c541b979f07c15ea41012e66b28a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:37,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:13:37,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d448c541b979f07c15ea41012e66b28a: 2023-07-16 06:13:37,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689487861166.d448c541b979f07c15ea41012e66b28a. 2023-07-16 06:13:37,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de10f23cf2984f34a4891a45eeea0cc4, disabling compactions & flushes 2023-07-16 06:13:37,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:13:37,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:13:37,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. after waiting 0 ms 2023-07-16 06:13:37,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:13:37,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing de10f23cf2984f34a4891a45eeea0cc4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 06:13:37,431 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:13:37,431 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:37,431 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:13:37,432 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39467,1689487858304 2023-07-16 06:13:37,432 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:37,431 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:37,432 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:37,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/rep_barrier/8b3cb98dbfe04502b1ed1ec4e207be97 2023-07-16 06:13:37,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b3cb98dbfe04502b1ed1ec4e207be97 2023-07-16 06:13:37,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/.tmp/l/d69294aa200946bfaa27946abf1af95a 2023-07-16 06:13:37,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d69294aa200946bfaa27946abf1af95a 2023-07-16 06:13:37,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/.tmp/l/d69294aa200946bfaa27946abf1af95a as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/l/d69294aa200946bfaa27946abf1af95a 2023-07-16 06:13:37,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/table/2c9c2bb3752d4d49ad27af57dba2f6cc 2023-07-16 06:13:37,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c9c2bb3752d4d49ad27af57dba2f6cc 2023-07-16 06:13:37,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d69294aa200946bfaa27946abf1af95a 2023-07-16 06:13:37,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/l/d69294aa200946bfaa27946abf1af95a, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 06:13:37,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/info/adf4a7a65f524329a0cce6bcfeb10c70 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/info/adf4a7a65f524329a0cce6bcfeb10c70 2023-07-16 06:13:37,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for de10f23cf2984f34a4891a45eeea0cc4 in 58ms, sequenceid=18, compaction requested=false 2023-07-16 06:13:37,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/acl/de10f23cf2984f34a4891a45eeea0cc4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 06:13:37,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adf4a7a65f524329a0cce6bcfeb10c70 2023-07-16 06:13:37,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/info/adf4a7a65f524329a0cce6bcfeb10c70, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 06:13:37,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:13:37,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de10f23cf2984f34a4891a45eeea0cc4: 2023-07-16 06:13:37,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689487861928.de10f23cf2984f34a4891a45eeea0cc4. 2023-07-16 06:13:37,495 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/rep_barrier/8b3cb98dbfe04502b1ed1ec4e207be97 as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/rep_barrier/8b3cb98dbfe04502b1ed1ec4e207be97 2023-07-16 06:13:37,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b3cb98dbfe04502b1ed1ec4e207be97 2023-07-16 06:13:37,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/rep_barrier/8b3cb98dbfe04502b1ed1ec4e207be97, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 06:13:37,500 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/.tmp/table/2c9c2bb3752d4d49ad27af57dba2f6cc as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/table/2c9c2bb3752d4d49ad27af57dba2f6cc 2023-07-16 06:13:37,500 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:13:37,500 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:13:37,500 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43885,1689487858173] 2023-07-16 06:13:37,500 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43885,1689487858173 2023-07-16 06:13:37,502 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43885,1689487858173; numProcessing=1 2023-07-16 06:13:37,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c9c2bb3752d4d49ad27af57dba2f6cc 2023-07-16 06:13:37,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/table/2c9c2bb3752d4d49ad27af57dba2f6cc, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 06:13:37,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 161ms, sequenceid=131, compaction requested=false 2023-07-16 06:13:37,547 DEBUG [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 06:13:37,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 06:13:37,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:37,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 06:13:37,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 06:13:37,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 06:13:37,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 06:13:37,585 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43885,1689487858173 already deleted, retry=false 2023-07-16 06:13:37,585 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43885,1689487858173 expired; onlineServers=2 2023-07-16 06:13:37,585 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39467,1689487858304] 2023-07-16 06:13:37,585 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39467,1689487858304; numProcessing=2 2023-07-16 06:13:37,600 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39467,1689487858304 already deleted, retry=false 2023-07-16 06:13:37,600 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39467,1689487858304 expired; onlineServers=1 2023-07-16 06:13:37,655 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,655 INFO [RS:2;jenkins-hbase4:39467] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39467,1689487858304; zookeeper connection closed. 2023-07-16 06:13:37,655 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:39467-0x1016cc1536e0003, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,655 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@212aa362] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@212aa362 2023-07-16 06:13:37,747 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33137,1689487858246; all regions closed. 2023-07-16 06:13:37,755 INFO [RS:0;jenkins-hbase4:43885] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43885,1689487858173; zookeeper connection closed. 2023-07-16 06:13:37,755 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,755 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:43885-0x1016cc1536e0001, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,756 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@d38de26] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@d38de26 2023-07-16 06:13:37,757 DEBUG [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs 2023-07-16 06:13:37,757 INFO [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33137%2C1689487858246.meta:.meta(num 1689487860808) 2023-07-16 06:13:37,767 DEBUG [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/oldWALs 2023-07-16 06:13:37,767 INFO [RS:1;jenkins-hbase4:33137] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33137%2C1689487858246:(num 1689487860579) 2023-07-16 06:13:37,768 DEBUG [RS:1;jenkins-hbase4:33137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,768 INFO [RS:1;jenkins-hbase4:33137] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:37,768 INFO [RS:1;jenkins-hbase4:33137] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:37,768 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:37,771 INFO [RS:1;jenkins-hbase4:33137] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33137 2023-07-16 06:13:37,773 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33137,1689487858246 2023-07-16 06:13:37,773 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:37,775 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33137,1689487858246] 2023-07-16 06:13:37,775 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33137,1689487858246; numProcessing=3 2023-07-16 06:13:37,777 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33137,1689487858246 already deleted, retry=false 2023-07-16 06:13:37,777 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33137,1689487858246 expired; onlineServers=0 2023-07-16 06:13:37,777 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39159,1689487856639' ***** 2023-07-16 06:13:37,777 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 06:13:37,799 DEBUG [M:0;jenkins-hbase4:39159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d5bc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39159,1689487856639 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39159,1689487856639; all regions closed. 2023-07-16 06:13:37,799 DEBUG [M:0;jenkins-hbase4:39159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:37,799 DEBUG [M:0;jenkins-hbase4:39159] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 06:13:37,799 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 06:13:37,799 DEBUG [M:0;jenkins-hbase4:39159] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 06:13:37,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487860050] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487860050,5,FailOnTimeoutGroup] 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 06:13:37,799 DEBUG [M:0;jenkins-hbase4:39159] master.HMaster(1512): Stopping service threads 2023-07-16 06:13:37,799 INFO [M:0;jenkins-hbase4:39159] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 06:13:37,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487860046] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487860046,5,FailOnTimeoutGroup] 2023-07-16 06:13:37,800 ERROR [M:0;jenkins-hbase4:39159] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 06:13:37,800 INFO [M:0;jenkins-hbase4:39159] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 06:13:37,800 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 06:13:37,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 06:13:37,802 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:13:37,802 INFO [M:0;jenkins-hbase4:39159] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 06:13:37,803 INFO [M:0;jenkins-hbase4:39159] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 06:13:37,803 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 06:13:37,804 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:37,804 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:37,804 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 06:13:37,804 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-16 06:13:37,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:13:37,804 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:37,804 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-16 06:13:37,804 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.36 KB heapSize=449.59 KB 2023-07-16 06:13:37,825 INFO [M:0;jenkins-hbase4:39159] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.36 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c8fc0d524b9242c4af211a55dabbb70d 2023-07-16 06:13:37,829 INFO [M:0;jenkins-hbase4:39159] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8fc0d524b9242c4af211a55dabbb70d 2023-07-16 06:13:37,830 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c8fc0d524b9242c4af211a55dabbb70d as hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c8fc0d524b9242c4af211a55dabbb70d 2023-07-16 06:13:37,834 INFO [M:0;jenkins-hbase4:39159] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8fc0d524b9242c4af211a55dabbb70d 2023-07-16 06:13:37,834 INFO [M:0;jenkins-hbase4:39159] regionserver.HStore(1080): Added hdfs://localhost:33329/user/jenkins/test-data/05faf768-e69f-6f93-9f7f-d5c28776378c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c8fc0d524b9242c4af211a55dabbb70d, entries=119, sequenceid=899, filesize=28.5 K 2023-07-16 06:13:37,835 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegion(2948): Finished flush of dataSize ~373.36 KB/382319, heapSize ~449.57 KB/460360, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-16 06:13:37,837 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:37,837 DEBUG [M:0;jenkins-hbase4:39159] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:13:37,842 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:37,842 INFO [M:0;jenkins-hbase4:39159] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 06:13:37,843 INFO [M:0;jenkins-hbase4:39159] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39159 2023-07-16 06:13:37,845 DEBUG [M:0;jenkins-hbase4:39159] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39159,1689487856639 already deleted, retry=false 2023-07-16 06:13:37,875 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,875 INFO [RS:1;jenkins-hbase4:33137] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33137,1689487858246; zookeeper connection closed. 2023-07-16 06:13:37,875 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): regionserver:33137-0x1016cc1536e0002, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,876 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53f35331] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53f35331 2023-07-16 06:13:37,876 INFO [Listener at jenkins-hbase4.apache.org/37817] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 06:13:37,976 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,976 INFO [M:0;jenkins-hbase4:39159] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39159,1689487856639; zookeeper connection closed. 2023-07-16 06:13:37,976 DEBUG [Listener at localhost/41857-EventThread] zookeeper.ZKWatcher(600): master:39159-0x1016cc1536e0000, quorum=127.0.0.1:56819, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:37,978 WARN [Listener at jenkins-hbase4.apache.org/37817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:37,984 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:38,088 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:38,089 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-471431616-172.31.14.131-1689487852597 (Datanode Uuid 929da384-5eae-4a42-861b-d394d06fea71) service to localhost/127.0.0.1:33329 2023-07-16 06:13:38,090 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data5/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,091 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data6/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,092 WARN [Listener at jenkins-hbase4.apache.org/37817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:38,095 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:38,199 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:38,199 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-471431616-172.31.14.131-1689487852597 (Datanode Uuid 3ba8bffb-889c-44cc-928a-365b4e139aef) service to localhost/127.0.0.1:33329 2023-07-16 06:13:38,200 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data3/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,200 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data4/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,204 WARN [Listener at jenkins-hbase4.apache.org/37817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:38,206 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:38,209 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:38,209 WARN [BP-471431616-172.31.14.131-1689487852597 heartbeating to localhost/127.0.0.1:33329] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-471431616-172.31.14.131-1689487852597 (Datanode Uuid 333a58b0-bd8a-436d-a484-a63f8d35a241) service to localhost/127.0.0.1:33329 2023-07-16 06:13:38,210 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data1/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,210 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23787da6-4726-6b2c-e79b-2495b0a30ecb/cluster_a4a4dfb2-92ec-c759-184f-c51642c60e6f/dfs/data/data2/current/BP-471431616-172.31.14.131-1689487852597] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:38,234 INFO [Listener at jenkins-hbase4.apache.org/37817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:38,360 INFO [Listener at jenkins-hbase4.apache.org/37817] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 06:13:38,470 INFO [Listener at jenkins-hbase4.apache.org/37817] hbase.HBaseTestingUtility(1293): Minicluster is down