2023-09-27 22:00:52,624 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-27 22:00:52,827 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6 2023-09-27 22:00:52,827 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-27 22:00:52,827 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-27 22:00:52,862 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-27 22:00:53,125 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-27 22:00:53,126 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6, deleteOnExit=true 2023-09-27 22:00:53,126 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-27 22:00:53,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/test.cache.data in system properties and HBase conf 2023-09-27 22:00:53,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 22:00:53,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop.log.dir in system properties and HBase conf 2023-09-27 22:00:53,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 22:00:53,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 22:00:53,130 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 22:00:53,462 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-27 22:00:53,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 22:00:53,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 22:00:53,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 22:00:53,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 22:00:53,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 22:00:53,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 22:00:53,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 22:00:53,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 22:00:53,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 22:00:53,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/nfs.dump.dir in system properties and HBase conf 2023-09-27 22:00:53,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir in system properties and HBase conf 2023-09-27 22:00:53,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 22:00:53,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 22:00:53,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-27 22:00:53,983 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 22:00:53,988 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 22:00:54,323 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-27 22:00:54,508 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-27 22:00:54,522 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:00:54,564 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:00:54,599 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_localhost_34879_hdfs____pmz1dv/webapp 2023-09-27 22:00:54,756 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34879 2023-09-27 22:00:54,767 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 22:00:54,768 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 22:00:55,270 WARN [Listener at localhost/36545] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 22:00:55,348 WARN [Listener at localhost/36545] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 22:00:55,393 WARN [Listener at localhost/36545] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:00:55,447 INFO [Listener at localhost/36545] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:00:55,456 INFO [Listener at localhost/36545] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_localhost_46649_datanode____yygxr4/webapp 2023-09-27 22:00:55,557 INFO [Listener at localhost/36545] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46649 2023-09-27 22:00:55,969 WARN [Listener at localhost/40469] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 22:00:55,985 WARN [Listener at localhost/40469] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 22:00:55,989 WARN [Listener at localhost/40469] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:00:55,991 INFO [Listener at localhost/40469] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:00:55,999 INFO [Listener at localhost/40469] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_localhost_44749_datanode____5qtzkz/webapp 2023-09-27 22:00:56,101 INFO [Listener at localhost/40469] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44749 2023-09-27 22:00:56,111 WARN [Listener at localhost/35631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 22:00:56,130 WARN [Listener at localhost/35631] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 22:00:56,137 WARN [Listener at localhost/35631] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:00:56,139 INFO [Listener at localhost/35631] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:00:56,151 INFO [Listener at localhost/35631] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_localhost_32877_datanode____9symrk/webapp 2023-09-27 22:00:56,272 INFO [Listener at localhost/35631] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32877 2023-09-27 22:00:56,289 WARN [Listener at localhost/42973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 22:00:56,562 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d1c56133de8f3fc: Processing first storage report for DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60 from datanode a16a8bb4-870b-48a6-b604-51689286974a 2023-09-27 22:00:56,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d1c56133de8f3fc: from storage DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60 node DatanodeRegistration(127.0.0.1:42049, datanodeUuid=a16a8bb4-870b-48a6-b604-51689286974a, infoPort=45773, infoSecurePort=0, ipcPort=42973, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b2c73e4fde3ee1: Processing first storage report for DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d from datanode f8eff38c-abdc-46d8-91f3-d5be8d05dfab 2023-09-27 22:00:56,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b2c73e4fde3ee1: from storage DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d node DatanodeRegistration(127.0.0.1:35531, datanodeUuid=f8eff38c-abdc-46d8-91f3-d5be8d05dfab, infoPort=35871, infoSecurePort=0, ipcPort=40469, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,565 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3442cadd22aff104: Processing first storage report for DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec from datanode 40dba600-1c9c-48e2-abba-311aff7db389 2023-09-27 22:00:56,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3442cadd22aff104: from storage DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec node DatanodeRegistration(127.0.0.1:36883, datanodeUuid=40dba600-1c9c-48e2-abba-311aff7db389, infoPort=34279, infoSecurePort=0, ipcPort=35631, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,565 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d1c56133de8f3fc: Processing first storage report for DS-e89c62cd-6b68-4ea9-b709-6e3c3d59470e from datanode a16a8bb4-870b-48a6-b604-51689286974a 2023-09-27 22:00:56,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d1c56133de8f3fc: from storage DS-e89c62cd-6b68-4ea9-b709-6e3c3d59470e node DatanodeRegistration(127.0.0.1:42049, datanodeUuid=a16a8bb4-870b-48a6-b604-51689286974a, infoPort=45773, infoSecurePort=0, ipcPort=42973, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,566 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b2c73e4fde3ee1: Processing first storage report for DS-9d9007c6-b5d8-455a-97f4-a9adae5c3175 from datanode f8eff38c-abdc-46d8-91f3-d5be8d05dfab 2023-09-27 22:00:56,566 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b2c73e4fde3ee1: from storage DS-9d9007c6-b5d8-455a-97f4-a9adae5c3175 node DatanodeRegistration(127.0.0.1:35531, datanodeUuid=f8eff38c-abdc-46d8-91f3-d5be8d05dfab, infoPort=35871, infoSecurePort=0, ipcPort=40469, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,566 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3442cadd22aff104: Processing first storage report for DS-c1d8207a-1643-4402-a42e-f43876701afa from datanode 40dba600-1c9c-48e2-abba-311aff7db389 2023-09-27 22:00:56,566 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3442cadd22aff104: from storage DS-c1d8207a-1643-4402-a42e-f43876701afa node DatanodeRegistration(127.0.0.1:36883, datanodeUuid=40dba600-1c9c-48e2-abba-311aff7db389, infoPort=34279, infoSecurePort=0, ipcPort=35631, storageInfo=lv=-57;cid=testClusterID;nsid=633046585;c=1695852054078), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 22:00:56,775 DEBUG [Listener at localhost/42973] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6 2023-09-27 22:00:56,879 INFO [Listener at localhost/42973] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/zookeeper_0, clientPort=51065, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-27 22:00:56,901 INFO [Listener at localhost/42973] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51065 2023-09-27 22:00:56,914 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:56,917 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:57,616 INFO [Listener at localhost/42973] util.FSUtils(471): Created version file at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 with version=8 2023-09-27 22:00:57,616 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/hbase-staging 2023-09-27 22:00:57,989 INFO [Listener at localhost/42973] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-27 22:00:58,500 INFO [Listener at localhost/42973] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 22:00:58,533 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:58,534 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:58,534 INFO [Listener at localhost/42973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 22:00:58,534 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:58,534 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 22:00:58,675 INFO [Listener at localhost/42973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 22:00:58,748 DEBUG [Listener at localhost/42973] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-27 22:00:58,840 INFO [Listener at localhost/42973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45673 2023-09-27 22:00:58,853 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:58,855 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:58,878 INFO [Listener at localhost/42973] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45673 connecting to ZooKeeper ensemble=127.0.0.1:51065 2023-09-27 22:00:58,931 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:456730x0, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 22:00:58,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45673-0x100ef6808bf0000 connected 2023-09-27 22:00:58,964 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 22:00:58,964 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:00:58,977 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 22:00:58,985 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45673 2023-09-27 22:00:58,985 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45673 2023-09-27 22:00:58,986 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45673 2023-09-27 22:00:58,986 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45673 2023-09-27 22:00:58,987 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45673 2023-09-27 22:00:58,993 INFO [Listener at localhost/42973] master.HMaster(444): hbase.rootdir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, hbase.cluster.distributed=false 2023-09-27 22:00:59,055 INFO [Listener at localhost/42973] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 22:00:59,055 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,055 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,055 INFO [Listener at localhost/42973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 22:00:59,056 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,056 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 22:00:59,060 INFO [Listener at localhost/42973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 22:00:59,063 INFO [Listener at localhost/42973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32927 2023-09-27 22:00:59,066 INFO [Listener at localhost/42973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 22:00:59,072 INFO [Listener at localhost/42973] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 22:00:59,073 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,075 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,077 INFO [Listener at localhost/42973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32927 connecting to ZooKeeper ensemble=127.0.0.1:51065 2023-09-27 22:00:59,082 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:329270x0, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 22:00:59,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32927-0x100ef6808bf0001 connected 2023-09-27 22:00:59,083 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 22:00:59,085 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:00:59,086 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 22:00:59,086 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32927 2023-09-27 22:00:59,087 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32927 2023-09-27 22:00:59,088 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32927 2023-09-27 22:00:59,089 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32927 2023-09-27 22:00:59,089 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32927 2023-09-27 22:00:59,102 INFO [Listener at localhost/42973] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 22:00:59,102 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,102 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,103 INFO [Listener at localhost/42973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 22:00:59,103 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,103 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 22:00:59,104 INFO [Listener at localhost/42973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 22:00:59,105 INFO [Listener at localhost/42973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33753 2023-09-27 22:00:59,106 INFO [Listener at localhost/42973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 22:00:59,108 INFO [Listener at localhost/42973] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 22:00:59,109 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,111 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,114 INFO [Listener at localhost/42973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33753 connecting to ZooKeeper ensemble=127.0.0.1:51065 2023-09-27 22:00:59,117 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:337530x0, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 22:00:59,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33753-0x100ef6808bf0002 connected 2023-09-27 22:00:59,119 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 22:00:59,120 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:00:59,120 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 22:00:59,125 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33753 2023-09-27 22:00:59,125 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33753 2023-09-27 22:00:59,125 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33753 2023-09-27 22:00:59,126 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33753 2023-09-27 22:00:59,126 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33753 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 22:00:59,138 INFO [Listener at localhost/42973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 22:00:59,140 INFO [Listener at localhost/42973] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40159 2023-09-27 22:00:59,140 INFO [Listener at localhost/42973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 22:00:59,141 INFO [Listener at localhost/42973] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 22:00:59,142 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,143 INFO [Listener at localhost/42973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,145 INFO [Listener at localhost/42973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40159 connecting to ZooKeeper ensemble=127.0.0.1:51065 2023-09-27 22:00:59,152 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:401590x0, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 22:00:59,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40159-0x100ef6808bf0003 connected 2023-09-27 22:00:59,153 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 22:00:59,154 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:00:59,154 DEBUG [Listener at localhost/42973] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 22:00:59,156 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40159 2023-09-27 22:00:59,156 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40159 2023-09-27 22:00:59,157 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40159 2023-09-27 22:00:59,157 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40159 2023-09-27 22:00:59,161 DEBUG [Listener at localhost/42973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40159 2023-09-27 22:00:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:00:59,172 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 22:00:59,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:00:59,193 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 22:00:59,193 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 22:00:59,193 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 22:00:59,193 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 22:00:59,194 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:00:59,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 22:00:59,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45673,1695852057804 from backup master directory 2023-09-27 22:00:59,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 22:00:59,201 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:00:59,201 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 22:00:59,202 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 22:00:59,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:00:59,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-27 22:00:59,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-27 22:00:59,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/hbase.id with ID: 12a7a111-f903-43b5-b33c-4a5eb183d4d8 2023-09-27 22:00:59,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 22:00:59,360 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:00:59,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x62e10562 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:00:59,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2999240f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:00:59,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 22:00:59,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-27 22:00:59,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-27 22:00:59,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-27 22:00:59,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 22:00:59,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 22:00:59,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 22:00:59,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store-tmp 2023-09-27 22:00:59,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:00:59,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 22:00:59,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:00:59,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:00:59,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 22:00:59,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:00:59,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:00:59,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 22:00:59,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/WALs/jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:00:59,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45673%2C1695852057804, suffix=, logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/WALs/jenkins-hbase4.apache.org,45673,1695852057804, archiveDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/oldWALs, maxLogs=10 2023-09-27 22:00:59,680 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK] 2023-09-27 22:00:59,680 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK] 2023-09-27 22:00:59,680 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK] 2023-09-27 22:00:59,689 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-27 22:00:59,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/WALs/jenkins-hbase4.apache.org,45673,1695852057804/jenkins-hbase4.apache.org%2C45673%2C1695852057804.1695852059620 2023-09-27 22:00:59,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK], DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK], DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK]] 2023-09-27 22:00:59,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-27 22:00:59,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:00:59,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,820 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,828 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-27 22:00:59,856 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-27 22:00:59,868 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:00:59,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 22:00:59,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:00:59,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59197774, jitterRate=-0.11788442730903625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:00:59,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 22:00:59,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-27 22:00:59,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-27 22:00:59,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-27 22:00:59,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-27 22:00:59,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-09-27 22:00:59,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-27 22:00:59,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-27 22:00:59,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-27 22:00:59,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-27 22:01:00,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-27 22:01:00,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-27 22:01:00,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-27 22:01:00,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-27 22:01:00,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-27 22:01:00,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-27 22:01:00,045 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:00,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-27 22:01:00,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-27 22:01:00,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-27 22:01:00,071 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 22:01:00,071 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 22:01:00,072 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:00,072 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 22:01:00,072 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 22:01:00,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45673,1695852057804, sessionid=0x100ef6808bf0000, setting cluster-up flag (Was=false) 2023-09-27 22:01:00,091 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:00,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-27 22:01:00,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:01:00,105 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:00,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-27 22:01:00,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:01:00,115 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp 2023-09-27 22:01:00,165 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(951): ClusterId : 12a7a111-f903-43b5-b33c-4a5eb183d4d8 2023-09-27 22:01:00,167 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(951): ClusterId : 12a7a111-f903-43b5-b33c-4a5eb183d4d8 2023-09-27 22:01:00,168 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(951): ClusterId : 12a7a111-f903-43b5-b33c-4a5eb183d4d8 2023-09-27 22:01:00,174 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 22:01:00,174 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 22:01:00,174 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 22:01:00,181 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 22:01:00,181 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 22:01:00,181 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 22:01:00,181 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 22:01:00,181 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 22:01:00,181 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 22:01:00,186 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 22:01:00,186 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 22:01:00,187 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 22:01:00,191 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ReadOnlyZKClient(139): Connect 0x747d6ee4 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:00,197 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ReadOnlyZKClient(139): Connect 0x3cbc7047 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:00,197 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ReadOnlyZKClient(139): Connect 0x3954eb73 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:00,208 DEBUG [RS:0;jenkins-hbase4:32927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37931229, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:00,208 DEBUG [RS:1;jenkins-hbase4:33753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aba9e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:00,209 DEBUG [RS:0;jenkins-hbase4:32927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ac8003, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 22:01:00,209 DEBUG [RS:1;jenkins-hbase4:33753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e850594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 22:01:00,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-27 22:01:00,237 DEBUG [RS:2;jenkins-hbase4:40159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@327b99a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:00,237 DEBUG [RS:2;jenkins-hbase4:40159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36441b37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 22:01:00,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:00,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-27 22:01:00,261 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32927 2023-09-27 22:01:00,261 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33753 2023-09-27 22:01:00,262 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40159 2023-09-27 22:01:00,266 INFO [RS:2;jenkins-hbase4:40159] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 22:01:00,266 INFO [RS:1;jenkins-hbase4:33753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 22:01:00,266 INFO [RS:0;jenkins-hbase4:32927] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 22:01:00,267 INFO [RS:1;jenkins-hbase4:33753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 22:01:00,267 INFO [RS:2;jenkins-hbase4:40159] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 22:01:00,267 INFO [RS:0;jenkins-hbase4:32927] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 22:01:00,267 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 22:01:00,267 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 22:01:00,267 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 22:01:00,268 INFO [RS:0;jenkins-hbase4:32927] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:00,268 INFO [RS:2;jenkins-hbase4:40159] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:00,269 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 22:01:00,268 INFO [RS:1;jenkins-hbase4:33753] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:00,269 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 22:01:00,269 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 22:01:00,272 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:32927, startcode=1695852059054 2023-09-27 22:01:00,272 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:40159, startcode=1695852059137 2023-09-27 22:01:00,272 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:33753, startcode=1695852059101 2023-09-27 22:01:00,290 DEBUG [RS:2;jenkins-hbase4:40159] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 22:01:00,290 DEBUG [RS:1;jenkins-hbase4:33753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 22:01:00,290 DEBUG [RS:0;jenkins-hbase4:32927] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 22:01:00,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-27 22:01:00,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 22:01:00,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,346 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58203, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 22:01:00,346 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59677, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 22:01:00,346 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55365, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 22:01:00,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695852090347 2023-09-27 22:01:00,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-27 22:01:00,357 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 22:01:00,357 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 22:01:00,358 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-27 22:01:00,362 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 22:01:00,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-27 22:01:00,365 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 22:01:00,369 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 22:01:00,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-27 22:01:00,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-27 22:01:00,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-27 22:01:00,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-27 22:01:00,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-27 22:01:00,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-27 22:01:00,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-27 22:01:00,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-27 22:01:00,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-27 22:01:00,391 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 22:01:00,391 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 22:01:00,392 WARN [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 22:01:00,391 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 22:01:00,392 WARN [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 22:01:00,392 WARN [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 22:01:00,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695852060392,5,FailOnTimeoutGroup] 2023-09-27 22:01:00,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695852060392,5,FailOnTimeoutGroup] 2023-09-27 22:01:00,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-27 22:01:00,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,416 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:00,417 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:00,417 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:00,438 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:00,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 22:01:00,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/info 2023-09-27 22:01:00,444 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 22:01:00,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 22:01:00,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/rep_barrier 2023-09-27 22:01:00,448 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 22:01:00,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 22:01:00,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/table 2023-09-27 22:01:00,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 22:01:00,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,454 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740 2023-09-27 22:01:00,455 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740 2023-09-27 22:01:00,459 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 22:01:00,461 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 22:01:00,465 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:00,465 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69521407, jitterRate=0.035949692130088806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 22:01:00,466 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 22:01:00,466 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 22:01:00,466 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 22:01:00,466 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 22:01:00,466 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 22:01:00,466 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 22:01:00,468 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 22:01:00,468 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 22:01:00,475 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 22:01:00,475 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-27 22:01:00,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-27 22:01:00,493 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:33753, startcode=1695852059101 2023-09-27 22:01:00,493 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:32927, startcode=1695852059054 2023-09-27 22:01:00,493 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45673,1695852057804 with isa=jenkins-hbase4.apache.org/172.31.14.131:40159, startcode=1695852059137 2023-09-27 22:01:00,498 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,505 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-27 22:01:00,505 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45673] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,506 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:00,506 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36545 2023-09-27 22:01:00,507 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 22:01:00,507 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:00,507 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36545 2023-09-27 22:01:00,507 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 22:01:00,508 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:00,508 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36545 2023-09-27 22:01:00,508 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 22:01:00,510 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-27 22:01:00,513 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:01:00,519 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ZKUtil(162): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,519 WARN [RS:0;jenkins-hbase4:32927] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 22:01:00,520 INFO [RS:0;jenkins-hbase4:32927] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 22:01:00,520 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,520 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ZKUtil(162): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,520 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40159,1695852059137] 2023-09-27 22:01:00,520 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ZKUtil(162): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,520 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32927,1695852059054] 2023-09-27 22:01:00,521 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33753,1695852059101] 2023-09-27 22:01:00,520 WARN [RS:2;jenkins-hbase4:40159] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 22:01:00,521 WARN [RS:1;jenkins-hbase4:33753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 22:01:00,521 INFO [RS:2;jenkins-hbase4:40159] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 22:01:00,521 INFO [RS:1;jenkins-hbase4:33753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 22:01:00,521 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,521 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,537 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ZKUtil(162): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,537 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ZKUtil(162): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,537 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ZKUtil(162): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,537 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ZKUtil(162): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,537 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ZKUtil(162): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,537 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ZKUtil(162): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,538 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ZKUtil(162): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,538 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ZKUtil(162): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,538 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ZKUtil(162): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,549 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 22:01:00,549 DEBUG [RS:1;jenkins-hbase4:33753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 22:01:00,549 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 22:01:00,559 INFO [RS:2;jenkins-hbase4:40159] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 22:01:00,559 INFO [RS:1;jenkins-hbase4:33753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 22:01:00,559 INFO [RS:0;jenkins-hbase4:32927] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 22:01:00,581 INFO [RS:2;jenkins-hbase4:40159] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 22:01:00,581 INFO [RS:0;jenkins-hbase4:32927] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 22:01:00,581 INFO [RS:1;jenkins-hbase4:33753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 22:01:00,585 INFO [RS:1;jenkins-hbase4:33753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 22:01:00,585 INFO [RS:0;jenkins-hbase4:32927] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 22:01:00,585 INFO [RS:2;jenkins-hbase4:40159] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 22:01:00,586 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,585 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,586 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,587 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 22:01:00,587 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 22:01:00,587 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 22:01:00,595 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,595 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,595 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,595 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 22:01:00,596 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,596 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:1;jenkins-hbase4:33753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 22:01:00,597 DEBUG [RS:0;jenkins-hbase4:32927] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,597 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,598 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,598 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,598 DEBUG [RS:2;jenkins-hbase4:40159] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 22:01:00,602 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,602 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,602 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,602 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,602 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,602 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,605 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,605 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,605 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,622 INFO [RS:0;jenkins-hbase4:32927] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 22:01:00,622 INFO [RS:2;jenkins-hbase4:40159] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 22:01:00,622 INFO [RS:1;jenkins-hbase4:33753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 22:01:00,626 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32927,1695852059054-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,626 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40159,1695852059137-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,626 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33753,1695852059101-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:00,647 INFO [RS:2;jenkins-hbase4:40159] regionserver.Replication(203): jenkins-hbase4.apache.org,40159,1695852059137 started 2023-09-27 22:01:00,648 INFO [RS:0;jenkins-hbase4:32927] regionserver.Replication(203): jenkins-hbase4.apache.org,32927,1695852059054 started 2023-09-27 22:01:00,648 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40159,1695852059137, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40159, sessionid=0x100ef6808bf0003 2023-09-27 22:01:00,648 INFO [RS:1;jenkins-hbase4:33753] regionserver.Replication(203): jenkins-hbase4.apache.org,33753,1695852059101 started 2023-09-27 22:01:00,648 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32927,1695852059054, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32927, sessionid=0x100ef6808bf0001 2023-09-27 22:01:00,648 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 22:01:00,648 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 22:01:00,648 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33753,1695852059101, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33753, sessionid=0x100ef6808bf0002 2023-09-27 22:01:00,648 DEBUG [RS:0;jenkins-hbase4:32927] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,649 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 22:01:00,649 DEBUG [RS:1;jenkins-hbase4:33753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,648 DEBUG [RS:2;jenkins-hbase4:40159] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,650 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40159,1695852059137' 2023-09-27 22:01:00,649 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33753,1695852059101' 2023-09-27 22:01:00,651 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 22:01:00,649 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32927,1695852059054' 2023-09-27 22:01:00,650 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 22:01:00,651 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 22:01:00,652 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 22:01:00,652 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 22:01:00,652 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 22:01:00,652 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 22:01:00,652 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 22:01:00,652 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 22:01:00,652 DEBUG [RS:0;jenkins-hbase4:32927] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,652 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 22:01:00,653 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 22:01:00,653 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32927,1695852059054' 2023-09-27 22:01:00,653 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:00,652 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 22:01:00,653 DEBUG [RS:2;jenkins-hbase4:40159] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:00,653 DEBUG [RS:1;jenkins-hbase4:33753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:00,653 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33753,1695852059101' 2023-09-27 22:01:00,653 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:00,653 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40159,1695852059137' 2023-09-27 22:01:00,653 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:00,654 DEBUG [RS:0;jenkins-hbase4:32927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:00,654 DEBUG [RS:2;jenkins-hbase4:40159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:00,654 DEBUG [RS:1;jenkins-hbase4:33753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:00,654 DEBUG [RS:0;jenkins-hbase4:32927] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 22:01:00,654 INFO [RS:0;jenkins-hbase4:32927] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 22:01:00,654 INFO [RS:0;jenkins-hbase4:32927] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 22:01:00,655 DEBUG [RS:2;jenkins-hbase4:40159] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 22:01:00,655 DEBUG [RS:1;jenkins-hbase4:33753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 22:01:00,655 INFO [RS:2;jenkins-hbase4:40159] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 22:01:00,655 INFO [RS:2;jenkins-hbase4:40159] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 22:01:00,655 INFO [RS:1;jenkins-hbase4:33753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 22:01:00,655 INFO [RS:1;jenkins-hbase4:33753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 22:01:00,662 DEBUG [jenkins-hbase4:45673] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-27 22:01:00,666 DEBUG [jenkins-hbase4:45673] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:00,672 DEBUG [jenkins-hbase4:45673] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:00,672 DEBUG [jenkins-hbase4:45673] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:00,672 DEBUG [jenkins-hbase4:45673] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:00,672 DEBUG [jenkins-hbase4:45673] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:00,675 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32927,1695852059054, state=OPENING 2023-09-27 22:01:00,681 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-27 22:01:00,684 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:00,684 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 22:01:00,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:00,766 INFO [RS:2;jenkins-hbase4:40159] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40159%2C1695852059137, suffix=, logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,40159,1695852059137, archiveDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs, maxLogs=32 2023-09-27 22:01:00,766 INFO [RS:1;jenkins-hbase4:33753] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33753%2C1695852059101, suffix=, logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,33753,1695852059101, archiveDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs, maxLogs=32 2023-09-27 22:01:00,766 INFO [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32927%2C1695852059054, suffix=, logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,32927,1695852059054, archiveDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs, maxLogs=32 2023-09-27 22:01:00,789 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK] 2023-09-27 22:01:00,790 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK] 2023-09-27 22:01:00,790 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK] 2023-09-27 22:01:00,803 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK] 2023-09-27 22:01:00,803 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK] 2023-09-27 22:01:00,803 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK] 2023-09-27 22:01:00,808 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK] 2023-09-27 22:01:00,808 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK] 2023-09-27 22:01:00,808 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK] 2023-09-27 22:01:00,809 INFO [RS:1;jenkins-hbase4:33753] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,33753,1695852059101/jenkins-hbase4.apache.org%2C33753%2C1695852059101.1695852060770 2023-09-27 22:01:00,813 DEBUG [RS:1;jenkins-hbase4:33753] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK], DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK], DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK]] 2023-09-27 22:01:00,814 INFO [RS:2;jenkins-hbase4:40159] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,40159,1695852059137/jenkins-hbase4.apache.org%2C40159%2C1695852059137.1695852060770 2023-09-27 22:01:00,814 DEBUG [RS:2;jenkins-hbase4:40159] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK], DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK], DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK]] 2023-09-27 22:01:00,815 INFO [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,32927,1695852059054/jenkins-hbase4.apache.org%2C32927%2C1695852059054.1695852060770 2023-09-27 22:01:00,815 DEBUG [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK], DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK], DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK]] 2023-09-27 22:01:00,881 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:00,884 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:01:00,887 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:01:00,901 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-27 22:01:00,902 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 22:01:00,905 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32927%2C1695852059054.meta, suffix=.meta, logDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,32927,1695852059054, archiveDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs, maxLogs=32 2023-09-27 22:01:00,923 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK] 2023-09-27 22:01:00,925 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK] 2023-09-27 22:01:00,925 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK] 2023-09-27 22:01:00,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/WALs/jenkins-hbase4.apache.org,32927,1695852059054/jenkins-hbase4.apache.org%2C32927%2C1695852059054.meta.1695852060906.meta 2023-09-27 22:01:00,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36883,DS-ee1bcb64-6f4e-484f-808a-43ab84c487ec,DISK], DatanodeInfoWithStorage[127.0.0.1:42049,DS-fe512a69-9f00-481f-a5ad-0e2dfa123e60,DISK], DatanodeInfoWithStorage[127.0.0.1:35531,DS-5677c5e3-0b3d-45b4-9e83-36017f93d61d,DISK]] 2023-09-27 22:01:00,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-27 22:01:00,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-27 22:01:00,934 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:00,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-27 22:01:00,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-27 22:01:00,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-27 22:01:00,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-27 22:01:00,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:00,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-27 22:01:00,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-27 22:01:00,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 22:01:00,959 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/info 2023-09-27 22:01:00,959 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/info 2023-09-27 22:01:00,959 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 22:01:00,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 22:01:00,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/rep_barrier 2023-09-27 22:01:00,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/rep_barrier 2023-09-27 22:01:00,962 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 22:01:00,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 22:01:00,964 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/table 2023-09-27 22:01:00,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/table 2023-09-27 22:01:00,965 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 22:01:00,966 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:00,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740 2023-09-27 22:01:00,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740 2023-09-27 22:01:00,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 22:01:00,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 22:01:00,977 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72175020, jitterRate=0.07549160718917847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 22:01:00,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 22:01:00,991 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695852060870 2023-09-27 22:01:01,012 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-27 22:01:01,013 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-27 22:01:01,015 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32927,1695852059054, state=OPEN 2023-09-27 22:01:01,018 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-27 22:01:01,019 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 22:01:01,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-27 22:01:01,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32927,1695852059054 in 330 msec 2023-09-27 22:01:01,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-27 22:01:01,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-09-27 22:01:01,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 788 msec 2023-09-27 22:01:01,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695852061037, completionTime=-1 2023-09-27 22:01:01,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-27 22:01:01,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-27 22:01:01,113 DEBUG [hconnection-0x66cf42e7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:01,116 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:01,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-27 22:01:01,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695852121145 2023-09-27 22:01:01,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695852181145 2023-09-27 22:01:01,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 107 msec 2023-09-27 22:01:01,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45673,1695852057804-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:01,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45673,1695852057804-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:01,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45673,1695852057804-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:01,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45673, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:01,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-27 22:01:01,184 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-27 22:01:01,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-27 22:01:01,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 22:01:01,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-27 22:01:01,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:01:01,208 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:01:01,230 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16 empty. 2023-09-27 22:01:01,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,234 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-27 22:01:01,275 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:01,277 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7b16fe5af51ffff75fb343bf8a08da16, NAME => 'hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:01,295 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:01,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7b16fe5af51ffff75fb343bf8a08da16, disabling compactions & flushes 2023-09-27 22:01:01,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. after waiting 0 ms 2023-09-27 22:01:01,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7b16fe5af51ffff75fb343bf8a08da16: 2023-09-27 22:01:01,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:01:01,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695852061303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852061303"}]},"ts":"1695852061303"} 2023-09-27 22:01:01,342 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 22:01:01,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:01:01,349 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852061344"}]},"ts":"1695852061344"} 2023-09-27 22:01:01,352 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-27 22:01:01,357 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:01,358 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:01,358 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:01,358 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:01,358 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:01,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7b16fe5af51ffff75fb343bf8a08da16, ASSIGN}] 2023-09-27 22:01:01,363 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7b16fe5af51ffff75fb343bf8a08da16, ASSIGN 2023-09-27 22:01:01,365 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7b16fe5af51ffff75fb343bf8a08da16, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40159,1695852059137; forceNewPlan=false, retain=false 2023-09-27 22:01:01,517 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 22:01:01,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7b16fe5af51ffff75fb343bf8a08da16, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:01,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695852061518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852061518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852061518"}]},"ts":"1695852061518"} 2023-09-27 22:01:01,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7b16fe5af51ffff75fb343bf8a08da16, server=jenkins-hbase4.apache.org,40159,1695852059137}] 2023-09-27 22:01:01,678 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:01,678 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:01:01,681 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:01:01,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b16fe5af51ffff75fb343bf8a08da16, NAME => 'hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.', STARTKEY => '', ENDKEY => ''} 2023-09-27 22:01:01,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. service=AccessControlService 2023-09-27 22:01:01,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:01,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:01,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,691 INFO [StoreOpener-7b16fe5af51ffff75fb343bf8a08da16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,694 DEBUG [StoreOpener-7b16fe5af51ffff75fb343bf8a08da16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/info 2023-09-27 22:01:01,694 DEBUG [StoreOpener-7b16fe5af51ffff75fb343bf8a08da16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/info 2023-09-27 22:01:01,694 INFO [StoreOpener-7b16fe5af51ffff75fb343bf8a08da16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b16fe5af51ffff75fb343bf8a08da16 columnFamilyName info 2023-09-27 22:01:01,695 INFO [StoreOpener-7b16fe5af51ffff75fb343bf8a08da16-1] regionserver.HStore(310): Store=7b16fe5af51ffff75fb343bf8a08da16/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:01,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:01:01,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:01,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b16fe5af51ffff75fb343bf8a08da16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71224187, jitterRate=0.06132309138774872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:01,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b16fe5af51ffff75fb343bf8a08da16: 2023-09-27 22:01:01,712 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16., pid=6, masterSystemTime=1695852061678 2023-09-27 22:01:01,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,717 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:01:01,720 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7b16fe5af51ffff75fb343bf8a08da16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:01,720 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695852061719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852061719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852061719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852061719"}]},"ts":"1695852061719"} 2023-09-27 22:01:01,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-27 22:01:01,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7b16fe5af51ffff75fb343bf8a08da16, server=jenkins-hbase4.apache.org,40159,1695852059137 in 200 msec 2023-09-27 22:01:01,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-27 22:01:01,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7b16fe5af51ffff75fb343bf8a08da16, ASSIGN in 366 msec 2023-09-27 22:01:01,733 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:01:01,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852061733"}]},"ts":"1695852061733"} 2023-09-27 22:01:01,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-27 22:01:01,740 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:01:01,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2023-09-27 22:01:01,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-27 22:01:01,807 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-27 22:01:01,807 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:01,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:01,829 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:01,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-27 22:01:01,857 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 22:01:01,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-09-27 22:01:01,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-27 22:01:01,887 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 22:01:01,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-27 22:01:01,900 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-27 22:01:01,903 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-27 22:01:01,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.702sec 2023-09-27 22:01:01,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-27 22:01:01,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-27 22:01:01,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-27 22:01:01,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45673,1695852057804-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-27 22:01:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45673,1695852057804-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-27 22:01:01,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 22:01:01,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-27 22:01:01,934 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:01:01,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:01:01,938 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:01,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-27 22:01:01,939 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e empty. 2023-09-27 22:01:01,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:01,942 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-27 22:01:01,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 22:01:01,963 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:01,965 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 163c8ad227763306b9c34de6ea2ef93e, NAME => 'hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:01,976 DEBUG [Listener at localhost/42973] zookeeper.ReadOnlyZKClient(139): Connect 0x6315ad62 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:01,988 DEBUG [Listener at localhost/42973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@782e04b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:01,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:01,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 163c8ad227763306b9c34de6ea2ef93e, disabling compactions & flushes 2023-09-27 22:01:01,994 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:01,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:01,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. after waiting 0 ms 2023-09-27 22:01:01,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:01,994 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:01,995 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 163c8ad227763306b9c34de6ea2ef93e: 2023-09-27 22:01:02,001 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:01:02,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695852062002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852062002"}]},"ts":"1695852062002"} 2023-09-27 22:01:02,006 DEBUG [hconnection-0x3061e5f0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:02,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 22:01:02,008 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:01:02,008 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852062008"}]},"ts":"1695852062008"} 2023-09-27 22:01:02,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-27 22:01:02,018 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:02,019 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:02,019 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:02,019 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:02,019 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:02,019 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:02,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=163c8ad227763306b9c34de6ea2ef93e, ASSIGN}] 2023-09-27 22:01:02,022 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=163c8ad227763306b9c34de6ea2ef93e, ASSIGN 2023-09-27 22:01:02,022 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:01:02,022 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/test.cache.data in system properties and HBase conf 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop.log.dir in system properties and HBase conf 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 22:01:02,023 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 22:01:02,024 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=163c8ad227763306b9c34de6ea2ef93e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 22:01:02,024 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/nfs.dump.dir in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir in system properties and HBase conf 2023-09-27 22:01:02,025 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 22:01:02,026 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 22:01:02,026 INFO [Listener at localhost/42973] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-27 22:01:02,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 22:01:02,174 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 22:01:02,175 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=163c8ad227763306b9c34de6ea2ef93e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:02,175 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695852062175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852062175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852062175"}]},"ts":"1695852062175"} 2023-09-27 22:01:02,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 163c8ad227763306b9c34de6ea2ef93e, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:02,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 22:01:02,338 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:02,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 163c8ad227763306b9c34de6ea2ef93e, NAME => 'hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.', STARTKEY => '', ENDKEY => ''} 2023-09-27 22:01:02,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. service=AccessControlService 2023-09-27 22:01:02,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:02,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:02,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,342 INFO [StoreOpener-163c8ad227763306b9c34de6ea2ef93e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,344 DEBUG [StoreOpener-163c8ad227763306b9c34de6ea2ef93e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/l 2023-09-27 22:01:02,344 DEBUG [StoreOpener-163c8ad227763306b9c34de6ea2ef93e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/l 2023-09-27 22:01:02,345 INFO [StoreOpener-163c8ad227763306b9c34de6ea2ef93e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 163c8ad227763306b9c34de6ea2ef93e columnFamilyName l 2023-09-27 22:01:02,346 INFO [StoreOpener-163c8ad227763306b9c34de6ea2ef93e-1] regionserver.HStore(310): Store=163c8ad227763306b9c34de6ea2ef93e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:02,349 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,355 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:01:02,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:02,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 163c8ad227763306b9c34de6ea2ef93e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65758694, jitterRate=-0.02011910080909729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:02,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 163c8ad227763306b9c34de6ea2ef93e: 2023-09-27 22:01:02,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e., pid=11, masterSystemTime=1695852062332 2023-09-27 22:01:02,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:02,365 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:01:02,366 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=163c8ad227763306b9c34de6ea2ef93e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:02,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695852062366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852062366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852062366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852062366"}]},"ts":"1695852062366"} 2023-09-27 22:01:02,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-27 22:01:02,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 163c8ad227763306b9c34de6ea2ef93e, server=jenkins-hbase4.apache.org,32927,1695852059054 in 192 msec 2023-09-27 22:01:02,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-27 22:01:02,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=163c8ad227763306b9c34de6ea2ef93e, ASSIGN in 356 msec 2023-09-27 22:01:02,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:01:02,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852062380"}]},"ts":"1695852062380"} 2023-09-27 22:01:02,383 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-27 22:01:02,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:01:02,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 457 msec 2023-09-27 22:01:02,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 22:01:02,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-27 22:01:02,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-27 22:01:03,236 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:01:03,603 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:01:03,610 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35343_jobhistory____m29s3d/webapp 2023-09-27 22:01:03,773 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-27 22:01:03,773 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-27 22:01:03,773 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 22:01:03,776 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 22:01:03,861 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:04,176 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:04,430 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-27 22:01:04,461 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35343 2023-09-27 22:01:04,730 WARN [Listener at jenkins-hbase4.apache.org/43563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:01:04,992 WARN [Listener at jenkins-hbase4.apache.org/43563] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 22:01:04,993 INFO [Listener at jenkins-hbase4.apache.org/43563] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:01:05,002 INFO [Listener at jenkins-hbase4.apache.org/43563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45315_cluster____17mlim/webapp 2023-09-27 22:01:05,086 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 22:01:05,086 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-27 22:01:05,086 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 22:01:05,087 INFO [Listener at jenkins-hbase4.apache.org/43563] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 22:01:05,098 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:05,293 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:05,391 INFO [Listener at jenkins-hbase4.apache.org/43563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:05,401 INFO [Listener at jenkins-hbase4.apache.org/43563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45315 2023-09-27 22:01:05,896 WARN [Listener at jenkins-hbase4.apache.org/39457] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:01:05,919 WARN [Listener at jenkins-hbase4.apache.org/39457] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 22:01:05,920 INFO [Listener at jenkins-hbase4.apache.org/39457] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:01:05,927 INFO [Listener at jenkins-hbase4.apache.org/39457] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38389_node____.va57mb/webapp 2023-09-27 22:01:06,007 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 22:01:06,007 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 22:01:06,007 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 22:01:06,007 INFO [Listener at jenkins-hbase4.apache.org/39457] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 22:01:06,016 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,039 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,119 INFO [Listener at jenkins-hbase4.apache.org/39457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,129 INFO [Listener at jenkins-hbase4.apache.org/39457] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38389 2023-09-27 22:01:06,324 WARN [Listener at jenkins-hbase4.apache.org/37371] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 22:01:06,330 WARN [Listener at jenkins-hbase4.apache.org/37371] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 22:01:06,330 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 22:01:06,337 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44353_node____2d7avj/webapp 2023-09-27 22:01:06,390 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 22:01:06,390 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 22:01:06,390 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 22:01:06,390 INFO [Listener at jenkins-hbase4.apache.org/37371] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 22:01:06,400 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,415 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,481 INFO [Listener at jenkins-hbase4.apache.org/37371] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 22:01:06,486 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44353 2023-09-27 22:01:06,503 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:01:06,519 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-27 22:01:06,523 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:06,602 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=165, AvailableMemoryMB=5474 2023-09-27 22:01:06,603 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-09-27 22:01:06,637 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-27 22:01:06,643 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-27 22:01:06,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:01:06,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:06,657 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:01:06,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-27 22:01:06,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:01:06,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 22:01:06,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:06,675 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 empty. 2023-09-27 22:01:06,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:06,677 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:06,680 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 empty. 2023-09-27 22:01:06,681 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:06,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 22:01:06,734 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:06,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b19b7697896536905df5f2f829c87cb7, NAME => 'testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:06,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4308470283e369415d4a2075321080e2, NAME => 'testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:06,752 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-27 22:01:06,755 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-27 22:01:06,756 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-27 22:01:06,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 22:01:06,794 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:06,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b19b7697896536905df5f2f829c87cb7, disabling compactions & flushes 2023-09-27 22:01:06,795 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:06,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:06,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:06,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4308470283e369415d4a2075321080e2, disabling compactions & flushes 2023-09-27 22:01:06,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. after waiting 0 ms 2023-09-27 22:01:06,795 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:06,796 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. after waiting 0 ms 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b19b7697896536905df5f2f829c87cb7: 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:06,796 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:06,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4308470283e369415d4a2075321080e2: 2023-09-27 22:01:06,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:01:06,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852066801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852066801"}]},"ts":"1695852066801"} 2023-09-27 22:01:06,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852066801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852066801"}]},"ts":"1695852066801"} 2023-09-27 22:01:06,853 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:01:06,855 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:01:06,855 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852066855"}]},"ts":"1695852066855"} 2023-09-27 22:01:06,857 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-27 22:01:06,862 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:06,864 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:06,864 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:06,864 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:06,864 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:06,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, ASSIGN}] 2023-09-27 22:01:06,868 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, ASSIGN 2023-09-27 22:01:06,868 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, ASSIGN 2023-09-27 22:01:06,869 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40159,1695852059137; forceNewPlan=false, retain=false 2023-09-27 22:01:06,869 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:01:06,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 22:01:07,020 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:01:07,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4308470283e369415d4a2075321080e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,023 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b19b7697896536905df5f2f829c87cb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852067023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852067023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852067023"}]},"ts":"1695852067023"} 2023-09-27 22:01:07,023 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852067023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852067023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852067023"}]},"ts":"1695852067023"} 2023-09-27 22:01:07,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4308470283e369415d4a2075321080e2, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:07,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure b19b7697896536905df5f2f829c87cb7, server=jenkins-hbase4.apache.org,40159,1695852059137}] 2023-09-27 22:01:07,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4308470283e369415d4a2075321080e2, NAME => 'testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. service=AccessControlService 2023-09-27 22:01:07,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:07,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b19b7697896536905df5f2f829c87cb7, NAME => 'testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:01:07,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. service=AccessControlService 2023-09-27 22:01:07,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:07,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:07,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,196 INFO [StoreOpener-4308470283e369415d4a2075321080e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,196 INFO [StoreOpener-b19b7697896536905df5f2f829c87cb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,198 DEBUG [StoreOpener-4308470283e369415d4a2075321080e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf 2023-09-27 22:01:07,198 DEBUG [StoreOpener-4308470283e369415d4a2075321080e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf 2023-09-27 22:01:07,198 DEBUG [StoreOpener-b19b7697896536905df5f2f829c87cb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf 2023-09-27 22:01:07,198 DEBUG [StoreOpener-b19b7697896536905df5f2f829c87cb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf 2023-09-27 22:01:07,202 INFO [StoreOpener-b19b7697896536905df5f2f829c87cb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b19b7697896536905df5f2f829c87cb7 columnFamilyName cf 2023-09-27 22:01:07,202 INFO [StoreOpener-4308470283e369415d4a2075321080e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4308470283e369415d4a2075321080e2 columnFamilyName cf 2023-09-27 22:01:07,205 INFO [StoreOpener-4308470283e369415d4a2075321080e2-1] regionserver.HStore(310): Store=4308470283e369415d4a2075321080e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:07,205 INFO [StoreOpener-b19b7697896536905df5f2f829c87cb7-1] regionserver.HStore(310): Store=b19b7697896536905df5f2f829c87cb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:07,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4308470283e369415d4a2075321080e2 2023-09-27 22:01:07,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:07,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:07,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b19b7697896536905df5f2f829c87cb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68384148, jitterRate=0.019003212451934814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:07,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:07,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b19b7697896536905df5f2f829c87cb7: 2023-09-27 22:01:07,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4308470283e369415d4a2075321080e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72333754, jitterRate=0.07785692811012268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:07,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4308470283e369415d4a2075321080e2: 2023-09-27 22:01:07,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7., pid=16, masterSystemTime=1695852067181 2023-09-27 22:01:07,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2., pid=15, masterSystemTime=1695852067179 2023-09-27 22:01:07,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:07,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:07,229 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b19b7697896536905df5f2f829c87cb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,229 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852067229"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852067229"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852067229"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852067229"}]},"ts":"1695852067229"} 2023-09-27 22:01:07,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:07,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:07,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4308470283e369415d4a2075321080e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852067232"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852067232"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852067232"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852067232"}]},"ts":"1695852067232"} 2023-09-27 22:01:07,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-27 22:01:07,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure b19b7697896536905df5f2f829c87cb7, server=jenkins-hbase4.apache.org,40159,1695852059137 in 206 msec 2023-09-27 22:01:07,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-27 22:01:07,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, ASSIGN in 373 msec 2023-09-27 22:01:07,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4308470283e369415d4a2075321080e2, server=jenkins-hbase4.apache.org,32927,1695852059054 in 210 msec 2023-09-27 22:01:07,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-27 22:01:07,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, ASSIGN in 376 msec 2023-09-27 22:01:07,247 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:01:07,247 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852067247"}]},"ts":"1695852067247"} 2023-09-27 22:01:07,249 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-27 22:01:07,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:01:07,258 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-27 22:01:07,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 22:01:07,278 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 22:01:07,317 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:07,317 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:07,317 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:07,317 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:01:07,317 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:07,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:07,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:07,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:07,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:07,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 678 msec 2023-09-27 22:01:07,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 22:01:07,777 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-27 22:01:07,781 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 22:01:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:07,785 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:07,815 DEBUG [hconnection-0x3061e5f0-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:07,820 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:07,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:07,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852067834 (current time:1695852067834). 2023-09-27 22:01:07,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:07,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x30ab1eeb to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61992aae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:07,845 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30ab1eeb to 127.0.0.1:51065 2023-09-27 22:01:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:07,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x59b534f3 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:07,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a00e72a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:07,856 DEBUG [hconnection-0x1efcef93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:07,858 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:07,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b534f3 to 127.0.0.1:51065 2023-09-27 22:01:07,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:07,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 22:01:07,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:07,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:07,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:07,912 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:07,914 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695852667914 2023-09-27 22:01:07,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:07,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 22:01:07,918 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:07,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:07,922 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:07,922 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:07,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-09-27 22:01:07,923 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:07,924 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695852667924 2023-09-27 22:01:07,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,955 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-27 22:01:07,955 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:07,955 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 22:01:07,955 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 22:01:07,956 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,956 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,962 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:07,962 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:07,962 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:07,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:07,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:07,962 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:07,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:07,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:07,963 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,963 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,964 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,964 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:07,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 22:01:07,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 22:01:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 22:01:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:07,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:07,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:07,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,974 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:07,974 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:07,974 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:07,974 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:07,974 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:07,975 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:07,975 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:07,976 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:07,980 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,980 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:07,981 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,981 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:07,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:07,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:07,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 22:01:07,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1018941c[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:07,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,985 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,985 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-27 22:01:07,985 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,985 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:07,986 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:07,986 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-27 22:01:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,986 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 22:01:07,986 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-27 22:01:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:07,987 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:07,987 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-27 22:01:07,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 22:01:07,987 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 22:01:07,987 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 22:01:07,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1018941c[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:07,987 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,987 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-27 22:01:07,990 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,990 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:07,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:07,991 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:07,991 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:07,991 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:07,991 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:07,992 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:07,992 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:07,992 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:07,993 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:07,994 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:07,994 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. started... 2023-09-27 22:01:07,994 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. started... 2023-09-27 22:01:07,994 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:07,995 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:07,995 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:07,999 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b19b7697896536905df5f2f829c87cb7: 2023-09-27 22:01:07,999 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4308470283e369415d4a2075321080e2: 2023-09-27 22:01:08,000 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,000 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,008 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:08,008 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:08,013 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:08,013 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:08,022 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:08,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:08,027 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:08,039 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. completed. 2023-09-27 22:01:08,040 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:08,040 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. completed. 2023-09-27 22:01:08,040 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:08,043 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,043 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,043 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,043 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:08,045 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,045 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:08,045 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,045 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40159,1695852059137': 2023-09-27 22:01:08,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 22:01:08,057 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-27 22:01:08,057 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:08,057 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:08,057 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,057 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:08,060 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,060 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,060 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,060 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,062 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,062 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,063 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,065 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,066 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,066 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,080 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,081 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 22:01:08,081 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:08,082 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,082 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,083 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:01:08,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 22:01:08,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695852067914Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695852068101 (+187 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695852068101Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695852068101Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695852068118 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695852068153 (+35 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695852068168 (+15 ms) 2023-09-27 22:01:08,171 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:08,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 255 msec 2023-09-27 22:01:08,227 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:08,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:08,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:08,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:08,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40159] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:08,255 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 22:01:08,255 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:08,255 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:08,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:08,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852068272 (current time:1695852068272). 2023-09-27 22:01:08,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:08,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x0b5488f5 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:08,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1877f6fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:08,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:08,282 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:08,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b5488f5 to 127.0.0.1:51065 2023-09-27 22:01:08,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x468d747f to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:08,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69315f7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:08,292 DEBUG [hconnection-0x4e5684b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:08,295 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x468d747f to 127.0.0.1:51065 2023-09-27 22:01:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 22:01:08,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:08,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:08,304 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:08,306 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695852668306 2023-09-27 22:01:08,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 22:01:08,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 22:01:08,307 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:08,307 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:08,308 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 22:01:08,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:08,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-27 22:01:08,311 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:08,311 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695852668311 2023-09-27 22:01:08,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-27 22:01:08,335 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-27 22:01:08,335 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:08,336 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 22:01:08,336 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 22:01:08,337 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,337 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,338 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,338 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,338 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,338 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,339 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,339 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,340 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 22:01:08,340 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 22:01:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:08,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 22:01:08,341 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:08,342 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:08,342 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:08,342 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:08,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 22:01:08,343 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:08,343 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 22:01:08,343 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:08,343 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 22:01:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 22:01:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:08,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 22:01:08,346 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,350 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,350 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,350 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,351 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,351 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436ea439[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 22:01:08,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436ea439[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:08,356 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 22:01:08,356 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,359 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,359 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,359 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:08,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,360 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:08,360 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:08,360 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. started... 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:08,360 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,360 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:08,360 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b19b7697896536905df5f2f829c87cb7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:08,360 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:08,361 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:08,361 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. started... 2023-09-27 22:01:08,361 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4308470283e369415d4a2075321080e2 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 22:01:08,363 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:08,363 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,363 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:08,407 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:08,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:08,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:08,409 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:08,499 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2 2023-09-27 22:01:08,499 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b 2023-09-27 22:01:08,532 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/.tmp/cf/319087babe4e4ae093f3dc9f92aa3a5d 2023-09-27 22:01:08,533 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/.tmp/cf/e4c6574e46424929a5ca6886baf391a7 2023-09-27 22:01:08,545 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/.tmp/cf/319087babe4e4ae093f3dc9f92aa3a5d as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d 2023-09-27 22:01:08,547 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/.tmp/cf/e4c6574e46424929a5ca6886baf391a7 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7 2023-09-27 22:01:08,555 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 22:01:08,555 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d, entries=46, sequenceid=6, filesize=12.6 K 2023-09-27 22:01:08,559 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4308470283e369415d4a2075321080e2 in 198ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:08,560 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 22:01:08,560 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b19b7697896536905df5f2f829c87cb7 in 200ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:08,560 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 22:01:08,562 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4308470283e369415d4a2075321080e2: 2023-09-27 22:01:08,562 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b19b7697896536905df5f2f829c87cb7: 2023-09-27 22:01:08,562 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7] hfiles 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7 for snapshot=snaptb0-testExportWithTargetName 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d] hfiles 2023-09-27 22:01:08,563 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d for snapshot=snaptb0-testExportWithTargetName 2023-09-27 22:01:08,591 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. completed. 2023-09-27 22:01:08,591 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:08,591 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:08,591 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:08,591 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,592 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:08,592 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:08,594 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,594 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,594 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,609 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:08,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 22:01:08,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:08,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:08,611 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 22:01:08,911 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:08,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:08,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:08,913 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 22:01:08,992 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. completed. 2023-09-27 22:01:08,992 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 22:01:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 22:01:08,995 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 22:01:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:08,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:08,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:08,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40159,1695852059137': 2023-09-27 22:01:09,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 22:01:09,001 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-27 22:01:09,001 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:09,001 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:09,001 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-27 22:01:09,001 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,003 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,004 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:09,005 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,005 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:09,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,008 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:09,008 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 22:01:09,009 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,020 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-27 22:01:09,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:09,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 22:01:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:09,021 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 22:01:09,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:09,021 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:09,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:09,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:09,022 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,023 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b] mob files 2023-09-27 22:01:09,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2 2023-09-27 22:01:09,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b 2023-09-27 22:01:09,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-27 22:01:09,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 22:01:09,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,089 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 22:01:09,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695852068306Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695852069043 (+737 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695852069043Loading Region manifests for snaptb0-testExportWithTargetName at 1695852069043Writing data manifest for snaptb0-testExportWithTargetName at 1695852069050 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695852069075 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695852069089 (+14 ms) 2023-09-27 22:01:09,092 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 22:01:09,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 786 msec 2023-09-27 22:01:09,413 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:09,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 22:01:09,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:09,417 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417 2023-09-27 22:01:09,418 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36545, tgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417, rawTgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:09,458 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:09,458 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-635786964_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 22:01:09,458 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-27 22:01:09,476 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 22:01:09,536 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:09,537 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:09,537 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:09,538 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,441 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-62983324020848680.jar 2023-09-27 22:01:10,441 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,442 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,510 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-3980549830033290720.jar 2023-09-27 22:01:10,511 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,511 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,512 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,512 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,512 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,513 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:10,513 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:01:10,514 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:01:10,514 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:01:10,515 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:01:10,515 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:01:10,516 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:01:10,516 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:01:10,516 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:01:10,517 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:01:10,517 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:01:10,521 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:10,523 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:10,523 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:11,757 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:01:11,763 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-27 22:01:11,771 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 22:01:12,234 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:12,236 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:12,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0001_000001 (auth:SIMPLE) 2023-09-27 22:01:12,695 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:01:16,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0001_000001 (auth:SIMPLE) 2023-09-27 22:01:19,099 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0001_000001 (auth:SIMPLE) 2023-09-27 22:01:21,908 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0001_000001 (auth:SIMPLE) 2023-09-27 22:01:23,604 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:01:23,607 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:01:23,622 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-27 22:01:23,623 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:01:23,623 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:01:23,624 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 22:01:23,624 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-27 22:01:23,624 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-27 22:01:23,624 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/testExportWithTargetName 2023-09-27 22:01:23,625 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-27 22:01:23,625 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852069417/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-27 22:01:23,636 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-27 22:01:23,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-27 22:01:23,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:23,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852083655"}]},"ts":"1695852083655"} 2023-09-27 22:01:23,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 22:01:23,657 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-27 22:01:23,675 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-27 22:01:23,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, UNASSIGN}] 2023-09-27 22:01:23,680 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, UNASSIGN 2023-09-27 22:01:23,680 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, UNASSIGN 2023-09-27 22:01:23,681 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4308470283e369415d4a2075321080e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:23,682 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b19b7697896536905df5f2f829c87cb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:23,682 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852083681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852083681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852083681"}]},"ts":"1695852083681"} 2023-09-27 22:01:23,682 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852083681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852083681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852083681"}]},"ts":"1695852083681"} 2023-09-27 22:01:23,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 4308470283e369415d4a2075321080e2, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:23,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b19b7697896536905df5f2f829c87cb7, server=jenkins-hbase4.apache.org,40159,1695852059137}] 2023-09-27 22:01:23,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 22:01:23,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4308470283e369415d4a2075321080e2 2023-09-27 22:01:23,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:23,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4308470283e369415d4a2075321080e2, disabling compactions & flushes 2023-09-27 22:01:23,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b19b7697896536905df5f2f829c87cb7, disabling compactions & flushes 2023-09-27 22:01:23,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:23,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. after waiting 0 ms 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. after waiting 0 ms 2023-09-27 22:01:23,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:23,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:01:23,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:01:23,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:23,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:23,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2. 2023-09-27 22:01:23,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7. 2023-09-27 22:01:23,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4308470283e369415d4a2075321080e2: 2023-09-27 22:01:23,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b19b7697896536905df5f2f829c87cb7: 2023-09-27 22:01:23,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:23,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b19b7697896536905df5f2f829c87cb7, regionState=CLOSED 2023-09-27 22:01:23,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852083865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852083865"}]},"ts":"1695852083865"} 2023-09-27 22:01:23,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4308470283e369415d4a2075321080e2 2023-09-27 22:01:23,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4308470283e369415d4a2075321080e2, regionState=CLOSED 2023-09-27 22:01:23,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695852083866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852083866"}]},"ts":"1695852083866"} 2023-09-27 22:01:23,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-27 22:01:23,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b19b7697896536905df5f2f829c87cb7, server=jenkins-hbase4.apache.org,40159,1695852059137 in 182 msec 2023-09-27 22:01:23,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-27 22:01:23,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 4308470283e369415d4a2075321080e2, server=jenkins-hbase4.apache.org,32927,1695852059054 in 185 msec 2023-09-27 22:01:23,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b19b7697896536905df5f2f829c87cb7, UNASSIGN in 195 msec 2023-09-27 22:01:23,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-27 22:01:23,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4308470283e369415d4a2075321080e2, UNASSIGN in 196 msec 2023-09-27 22:01:23,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852083876"}]},"ts":"1695852083876"} 2023-09-27 22:01:23,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-27 22:01:23,952 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-27 22:01:23,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 308 msec 2023-09-27 22:01:23,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 22:01:23,959 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-27 22:01:23,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-27 22:01:23,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:23,973 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:23,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-27 22:01:23,975 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:23,978 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-27 22:01:23,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:23,981 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:23,985 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/recovered.edits] 2023-09-27 22:01:23,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/recovered.edits] 2023-09-27 22:01:23,992 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/cf/319087babe4e4ae093f3dc9f92aa3a5d 2023-09-27 22:01:23,993 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/cf/e4c6574e46424929a5ca6886baf391a7 2023-09-27 22:01:23,997 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2/recovered.edits/9.seqid 2023-09-27 22:01:23,997 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7/recovered.edits/9.seqid 2023-09-27 22:01:23,998 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/4308470283e369415d4a2075321080e2 2023-09-27 22:01:23,998 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportWithTargetName/b19b7697896536905df5f2f829c87cb7 2023-09-27 22:01:23,998 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 22:01:23,998 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 22:01:23,999 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-27 22:01:24,003 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309277494866fbdb1428aa4a62e57a2b8c8d2 2023-09-27 22:01:24,005 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092709d3bb3087d6422585fef7d6b9e1a04b 2023-09-27 22:01:24,005 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 22:01:24,008 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:24,029 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-27 22:01:24,029 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 22:01:24,029 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 22:01:24,029 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 22:01:24,029 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 22:01:24,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-27 22:01:24,035 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:24,035 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-27 22:01:24,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852084035"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:24,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852084035"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:24,038 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:01:24,038 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4308470283e369415d4a2075321080e2, NAME => 'testtb-testExportWithTargetName,,1695852066651.4308470283e369415d4a2075321080e2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b19b7697896536905df5f2f829c87cb7, NAME => 'testtb-testExportWithTargetName,1,1695852066651.b19b7697896536905df5f2f829c87cb7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:01:24,038 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-27 22:01:24,038 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852084038"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:24,040 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-27 22:01:24,075 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,075 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 22:01:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 22:01:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 22:01:24,075 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,075 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,075 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:01:24,075 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:01:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 22:01:24,076 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:01:24,075 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:01:24,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 22:01:24,099 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 22:01:24,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 135 msec 2023-09-27 22:01:24,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 22:01:24,180 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-27 22:01:24,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-27 22:01:24,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-27 22:01:24,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-27 22:01:24,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-27 22:01:24,235 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=749 (was 703) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:38613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:58948 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:36293 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1507466710_1 at /127.0.0.1:58936 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1507466710_1 at /127.0.0.1:41510 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:41536 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:39457 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:47904 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 115) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4677 (was 5474) 2023-09-27 22:01:24,236 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 22:01:24,256 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=749, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=158, ProcessCount=168, AvailableMemoryMB=4675 2023-09-27 22:01:24,256 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 22:01:24,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:01:24,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:24,262 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:01:24,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-27 22:01:24,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:01:24,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 22:01:24,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 empty. 2023-09-27 22:01:24,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d empty. 2023-09-27 22:01:24,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,268 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,268 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 22:01:24,280 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:24,282 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c409ac6f4f9a88813a5148e4588447e5, NAME => 'testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:24,282 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0c6d242147197ca87b63bc2c8eb7374d, NAME => 'testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:24,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c409ac6f4f9a88813a5148e4588447e5, disabling compactions & flushes 2023-09-27 22:01:24,306 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. after waiting 0 ms 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,306 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c409ac6f4f9a88813a5148e4588447e5: 2023-09-27 22:01:24,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:24,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0c6d242147197ca87b63bc2c8eb7374d, disabling compactions & flushes 2023-09-27 22:01:24,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. after waiting 0 ms 2023-09-27 22:01:24,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,308 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,308 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0c6d242147197ca87b63bc2c8eb7374d: 2023-09-27 22:01:24,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:01:24,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852084311"}]},"ts":"1695852084311"} 2023-09-27 22:01:24,312 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852084311"}]},"ts":"1695852084311"} 2023-09-27 22:01:24,314 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:01:24,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:01:24,316 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852084315"}]},"ts":"1695852084315"} 2023-09-27 22:01:24,317 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 22:01:24,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 22:01:24,390 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:24,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:24,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:24,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:24,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:24,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, ASSIGN}] 2023-09-27 22:01:24,396 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, ASSIGN 2023-09-27 22:01:24,396 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, ASSIGN 2023-09-27 22:01:24,397 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:01:24,397 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33753,1695852059101; forceNewPlan=false, retain=false 2023-09-27 22:01:24,547 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:01:24,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0c6d242147197ca87b63bc2c8eb7374d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:24,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c409ac6f4f9a88813a5148e4588447e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:24,550 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852084549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852084549"}]},"ts":"1695852084549"} 2023-09-27 22:01:24,550 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852084549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852084549"}]},"ts":"1695852084549"} 2023-09-27 22:01:24,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 0c6d242147197ca87b63bc2c8eb7374d, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:01:24,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure c409ac6f4f9a88813a5148e4588447e5, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:24,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 22:01:24,706 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:24,706 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:01:24,710 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:01:24,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c409ac6f4f9a88813a5148e4588447e5, NAME => 'testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:01:24,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. service=AccessControlService 2023-09-27 22:01:24,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:24,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:24,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,717 INFO [StoreOpener-c409ac6f4f9a88813a5148e4588447e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c6d242147197ca87b63bc2c8eb7374d, NAME => 'testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:01:24,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. service=AccessControlService 2023-09-27 22:01:24,719 DEBUG [StoreOpener-c409ac6f4f9a88813a5148e4588447e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf 2023-09-27 22:01:24,719 DEBUG [StoreOpener-c409ac6f4f9a88813a5148e4588447e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf 2023-09-27 22:01:24,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:24,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:24,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,720 INFO [StoreOpener-c409ac6f4f9a88813a5148e4588447e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c409ac6f4f9a88813a5148e4588447e5 columnFamilyName cf 2023-09-27 22:01:24,721 INFO [StoreOpener-0c6d242147197ca87b63bc2c8eb7374d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,721 INFO [StoreOpener-c409ac6f4f9a88813a5148e4588447e5-1] regionserver.HStore(310): Store=c409ac6f4f9a88813a5148e4588447e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:24,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,723 DEBUG [StoreOpener-0c6d242147197ca87b63bc2c8eb7374d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf 2023-09-27 22:01:24,723 DEBUG [StoreOpener-0c6d242147197ca87b63bc2c8eb7374d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf 2023-09-27 22:01:24,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,724 INFO [StoreOpener-0c6d242147197ca87b63bc2c8eb7374d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c6d242147197ca87b63bc2c8eb7374d columnFamilyName cf 2023-09-27 22:01:24,725 INFO [StoreOpener-0c6d242147197ca87b63bc2c8eb7374d-1] regionserver.HStore(310): Store=0c6d242147197ca87b63bc2c8eb7374d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:24,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:24,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:24,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c409ac6f4f9a88813a5148e4588447e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71211753, jitterRate=0.061137810349464417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:24,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c409ac6f4f9a88813a5148e4588447e5: 2023-09-27 22:01:24,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:24,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5., pid=31, masterSystemTime=1695852084706 2023-09-27 22:01:24,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:24,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c6d242147197ca87b63bc2c8eb7374d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71789033, jitterRate=0.06973995268344879}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:24,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c6d242147197ca87b63bc2c8eb7374d: 2023-09-27 22:01:24,738 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c409ac6f4f9a88813a5148e4588447e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:24,738 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852084738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852084738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852084738"}]},"ts":"1695852084738"} 2023-09-27 22:01:24,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d., pid=30, masterSystemTime=1695852084706 2023-09-27 22:01:24,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:24,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0c6d242147197ca87b63bc2c8eb7374d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:24,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852084744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852084744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852084744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852084744"}]},"ts":"1695852084744"} 2023-09-27 22:01:24,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-27 22:01:24,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure c409ac6f4f9a88813a5148e4588447e5, server=jenkins-hbase4.apache.org,32927,1695852059054 in 189 msec 2023-09-27 22:01:24,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, ASSIGN in 354 msec 2023-09-27 22:01:24,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-27 22:01:24,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 0c6d242147197ca87b63bc2c8eb7374d, server=jenkins-hbase4.apache.org,33753,1695852059101 in 195 msec 2023-09-27 22:01:24,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-27 22:01:24,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, ASSIGN in 359 msec 2023-09-27 22:01:24,754 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:01:24,754 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852084754"}]},"ts":"1695852084754"} 2023-09-27 22:01:24,756 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 22:01:24,768 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:01:24,768 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-27 22:01:24,770 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:01:24,798 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,798 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,798 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,798 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:24,814 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 22:01:24,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:24,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:24,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:24,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:24,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 578 msec 2023-09-27 22:01:24,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 22:01:24,868 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-27 22:01:24,870 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 22:01:24,871 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:24,872 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:24,884 DEBUG [hconnection-0x3061e5f0-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:24,889 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:24,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:24,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852084893 (current time:1695852084893). 2023-09-27 22:01:24,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:24,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x442dc9ed to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:24,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c373ff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:24,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:24,934 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:24,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x442dc9ed to 127.0.0.1:51065 2023-09-27 22:01:24,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:24,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x3fb34b48 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:24,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@157b9ff2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:24,993 DEBUG [hconnection-0x1036da24-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:24,994 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:24,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fb34b48 to 127.0.0.1:51065 2023-09-27 22:01:24,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:24,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:01:25,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:25,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:25,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,003 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,004 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695852685004 2023-09-27 22:01:25,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 22:01:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:25,006 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:25,007 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,007 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:25,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-27 22:01:25,010 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,011 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695852685011 2023-09-27 22:01:25,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,031 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-27 22:01:25,031 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,033 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 22:01:25,033 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 22:01:25,107 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:25,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:25,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:25,109 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:25,116 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,116 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,121 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,121 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,121 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,121 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,121 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,122 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,122 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,122 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:25,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,123 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,126 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,125 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,129 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,129 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,148 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,148 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58e304d3[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 22:01:25,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58e304d3[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:25,153 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 22:01:25,153 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,155 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,155 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,155 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,155 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,155 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,155 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:25,156 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:25,156 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. started... 2023-09-27 22:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:25,156 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. started... 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c6d242147197ca87b63bc2c8eb7374d: 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c409ac6f4f9a88813a5148e4588447e5: 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:25,158 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,186 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. completed. 2023-09-27 22:01:25,186 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:25,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:25,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:25,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:25,188 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. completed. 2023-09-27 22:01:25,188 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:25,189 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,189 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,189 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,189 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,193 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:25,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 22:01:25,201 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-27 22:01:25,201 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:25,201 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:25,201 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,201 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,203 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,204 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,204 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,205 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,207 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,208 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,208 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,211 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,211 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,211 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,211 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,211 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,212 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,212 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,212 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,212 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,212 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,213 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,212 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 22:01:25,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,213 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:25,214 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,214 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,214 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,214 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,214 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:01:25,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 22:01:25,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,256 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:25,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695852085005Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695852085227 (+222 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695852085227Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695852085228 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695852085237 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695852085247 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695852085255 (+8 ms) 2023-09-27 22:01:25,259 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 254 msec 2023-09-27 22:01:25,309 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:25,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:25,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:25,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:25,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33753] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:25,323 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 22:01:25,323 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:25,324 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:25,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852085337 (current time:1695852085337). 2023-09-27 22:01:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:25,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x231adaf2 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:25,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f28fa2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:25,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:25,351 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:25,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x231adaf2 to 127.0.0.1:51065 2023-09-27 22:01:25,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:25,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x3a53c166 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:25,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17ca03f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:25,368 DEBUG [hconnection-0xc138ee7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:25,371 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a53c166 to 127.0.0.1:51065 2023-09-27 22:01:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:01:25,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:25,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:25,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,381 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,382 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695852685382 2023-09-27 22:01:25,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 22:01:25,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:01:25,384 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:25,384 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:25,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,386 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:01:25,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 22:01:25,389 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,397 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695852685397 2023-09-27 22:01:25,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-27 22:01:25,408 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-27 22:01:25,409 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,410 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 22:01:25,410 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 22:01:25,410 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,410 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,413 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,413 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,414 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,414 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,414 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 22:01:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 22:01:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,418 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,418 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 22:01:25,418 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 22:01:25,418 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 22:01:25,420 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,422 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,422 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,422 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,422 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,422 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,422 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,422 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8fc3a7[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 22:01:25,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8fc3a7[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:25,427 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 22:01:25,427 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:01:25,430 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,430 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:25,429 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:25,429 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:25,430 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:25,430 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. started... 2023-09-27 22:01:25,430 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. started... 2023-09-27 22:01:25,430 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:25,430 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c409ac6f4f9a88813a5148e4588447e5 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-27 22:01:25,430 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0c6d242147197ca87b63bc2c8eb7374d 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-27 22:01:25,430 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:25,432 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,432 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,432 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,469 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e 2023-09-27 22:01:25,472 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11 2023-09-27 22:01:25,484 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:25,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:25,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:25,486 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:25,489 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/.tmp/cf/2720a1fec00149efac177e573e585f34 2023-09-27 22:01:25,494 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/.tmp/cf/d831409f17fd4170bfdbdc0df630ae1e 2023-09-27 22:01:25,497 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/.tmp/cf/2720a1fec00149efac177e573e585f34 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34 2023-09-27 22:01:25,502 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/.tmp/cf/d831409f17fd4170bfdbdc0df630ae1e as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e 2023-09-27 22:01:25,503 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34, entries=6, sequenceid=6, filesize=5.9 K 2023-09-27 22:01:25,511 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for c409ac6f4f9a88813a5148e4588447e5 in 81ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:25,512 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c409ac6f4f9a88813a5148e4588447e5: 2023-09-27 22:01:25,513 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 22:01:25,513 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:25,513 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34] hfiles 2023-09-27 22:01:25,513 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 22:01:25,520 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e, entries=44, sequenceid=6, filesize=12.3 K 2023-09-27 22:01:25,521 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 0c6d242147197ca87b63bc2c8eb7374d in 91ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:25,521 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c6d242147197ca87b63bc2c8eb7374d: 2023-09-27 22:01:25,522 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 22:01:25,522 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:25,522 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e] hfiles 2023-09-27 22:01:25,522 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e for snapshot=snaptb0-testExportFileSystemState 2023-09-27 22:01:25,542 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. completed. 2023-09-27 22:01:25,542 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:25,549 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,549 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,549 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,550 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:01:25,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 22:01:25,686 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:25,688 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 22:01:25,933 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. completed. 2023-09-27 22:01:25,933 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 22:01:25,934 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:25,935 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 22:01:25,935 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 22:01:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:25,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 22:01:25,941 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-27 22:01:25,941 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:25,941 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:25,941 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-27 22:01:25,941 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:25,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,943 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,943 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:25,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,944 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:25,945 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:25,946 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 22:01:25,947 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,947 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:25,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-27 22:01:25,951 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,951 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:25,951 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,952 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:25,953 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:25,953 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,953 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,950 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 22:01:25,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:25,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 22:01:25,951 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:25,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:25,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e] mob files 2023-09-27 22:01:25,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11 2023-09-27 22:01:25,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e 2023-09-27 22:01:25,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-27 22:01:25,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,988 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:25,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:25,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:25,989 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 22:01:25,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 22:01:25,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,990 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 22:01:25,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695852085382Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695852085967 (+585 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695852085967Loading Region manifests for snaptb0-testExportFileSystemState at 1695852085967Writing data manifest for snaptb0-testExportFileSystemState at 1695852085971 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695852085981 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695852085990 (+9 ms) 2023-09-27 22:01:25,993 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 22:01:25,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 609 msec 2023-09-27 22:01:26,490 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:26,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:01:26,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:26,491 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491 2023-09-27 22:01:26,492 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36545, tgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491, rawTgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:26,527 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:26,527 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-751636305_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 22:01:26,527 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-27 22:01:26,542 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 22:01:26,569 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:26,569 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:26,570 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:26,570 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,458 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-8586588906282583233.jar 2023-09-27 22:01:27,458 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,459 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,530 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-8127050817964909553.jar 2023-09-27 22:01:27,530 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,531 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,531 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,531 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:01:27,533 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:01:27,533 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:01:27,534 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:01:27,534 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:01:27,535 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:01:27,535 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:01:27,535 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:01:27,536 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:01:27,536 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:01:27,537 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:27,537 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:27,538 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:27,539 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:27,539 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:27,540 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:27,541 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:28,001 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:01:28,003 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-27 22:01:28,006 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 22:01:28,123 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:28,123 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:28,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0001_000001 (auth:SIMPLE) 2023-09-27 22:01:28,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0002_000001 (auth:SIMPLE) 2023-09-27 22:01:29,497 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:01:32,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0002_000001 (auth:SIMPLE) 2023-09-27 22:01:34,778 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0002_000001 (auth:SIMPLE) 2023-09-27 22:01:37,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0002_000001 (auth:SIMPLE) 2023-09-27 22:01:39,213 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:01:39,214 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:01:39,222 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-27 22:01:39,222 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:01:39,223 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:01:39,223 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 22:01:39,223 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 22:01:39,223 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 22:01:39,223 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 22:01:39,224 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 22:01:39,224 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852086491/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 22:01:39,231 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-27 22:01:39,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-27 22:01:39,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 22:01:39,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852099236"}]},"ts":"1695852099236"} 2023-09-27 22:01:39,238 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 22:01:39,241 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-27 22:01:39,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, UNASSIGN}] 2023-09-27 22:01:39,244 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, UNASSIGN 2023-09-27 22:01:39,244 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, UNASSIGN 2023-09-27 22:01:39,245 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c409ac6f4f9a88813a5148e4588447e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:39,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0c6d242147197ca87b63bc2c8eb7374d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:39,245 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852099245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852099245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852099245"}]},"ts":"1695852099245"} 2023-09-27 22:01:39,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852099245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852099245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852099245"}]},"ts":"1695852099245"} 2023-09-27 22:01:39,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c409ac6f4f9a88813a5148e4588447e5, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:39,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 0c6d242147197ca87b63bc2c8eb7374d, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:01:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 22:01:39,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:39,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c409ac6f4f9a88813a5148e4588447e5, disabling compactions & flushes 2023-09-27 22:01:39,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:39,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. after waiting 0 ms 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c6d242147197ca87b63bc2c8eb7374d, disabling compactions & flushes 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:39,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. after waiting 0 ms 2023-09-27 22:01:39,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:39,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:01:39,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:01:39,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:39,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:01:39,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d. 2023-09-27 22:01:39,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c6d242147197ca87b63bc2c8eb7374d: 2023-09-27 22:01:39,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5. 2023-09-27 22:01:39,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c409ac6f4f9a88813a5148e4588447e5: 2023-09-27 22:01:39,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:39,413 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0c6d242147197ca87b63bc2c8eb7374d, regionState=CLOSED 2023-09-27 22:01:39,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:39,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852099413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852099413"}]},"ts":"1695852099413"} 2023-09-27 22:01:39,414 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c409ac6f4f9a88813a5148e4588447e5, regionState=CLOSED 2023-09-27 22:01:39,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695852099414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852099414"}]},"ts":"1695852099414"} 2023-09-27 22:01:39,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-27 22:01:39,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 0c6d242147197ca87b63bc2c8eb7374d, server=jenkins-hbase4.apache.org,33753,1695852059101 in 168 msec 2023-09-27 22:01:39,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-27 22:01:39,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c409ac6f4f9a88813a5148e4588447e5, server=jenkins-hbase4.apache.org,32927,1695852059054 in 171 msec 2023-09-27 22:01:39,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0c6d242147197ca87b63bc2c8eb7374d, UNASSIGN in 176 msec 2023-09-27 22:01:39,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-27 22:01:39,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c409ac6f4f9a88813a5148e4588447e5, UNASSIGN in 177 msec 2023-09-27 22:01:39,422 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852099422"}]},"ts":"1695852099422"} 2023-09-27 22:01:39,423 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 22:01:39,425 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-27 22:01:39,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-27 22:01:39,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 22:01:39,538 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-27 22:01:39,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-27 22:01:39,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-27 22:01:39,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,545 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-27 22:01:39,548 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,548 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,548 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,548 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 22:01:39,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 22:01:39,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 22:01:39,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 22:01:39,549 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:39,549 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:39,550 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:39,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 22:01:39,552 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/recovered.edits] 2023-09-27 22:01:39,553 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/recovered.edits] 2023-09-27 22:01:39,556 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/cf/2720a1fec00149efac177e573e585f34 2023-09-27 22:01:39,557 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/cf/d831409f17fd4170bfdbdc0df630ae1e 2023-09-27 22:01:39,560 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5/recovered.edits/9.seqid 2023-09-27 22:01:39,561 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/c409ac6f4f9a88813a5148e4588447e5 2023-09-27 22:01:39,561 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d/recovered.edits/9.seqid 2023-09-27 22:01:39,562 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemState/0c6d242147197ca87b63bc2c8eb7374d 2023-09-27 22:01:39,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 22:01:39,563 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 22:01:39,563 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-27 22:01:39,567 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309275a8915e02db04d0c94586041797c6a11 2023-09-27 22:01:39,568 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309275864aa2e8b3d43e3a7c593fd8477304e 2023-09-27 22:01:39,569 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 22:01:39,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,574 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-27 22:01:39,576 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-27 22:01:39,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-27 22:01:39,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852099577"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:39,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852099577"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:39,579 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:01:39,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c409ac6f4f9a88813a5148e4588447e5, NAME => 'testtb-testExportFileSystemState,,1695852084257.c409ac6f4f9a88813a5148e4588447e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0c6d242147197ca87b63bc2c8eb7374d, NAME => 'testtb-testExportFileSystemState,1,1695852084257.0c6d242147197ca87b63bc2c8eb7374d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:01:39,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-27 22:01:39,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852099579"}]},"ts":"9223372036854775807"} 2023-09-27 22:01:39,582 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-27 22:01:39,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 22:01:39,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-09-27 22:01:39,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 22:01:39,653 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-27 22:01:39,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-27 22:01:39,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-27 22:01:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-27 22:01:39,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-27 22:01:39,696 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 749) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:35482 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1894102175_1 at /127.0.0.1:35460 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1894102175_1 at /127.0.0.1:55720 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:53428 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:37371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:36189 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:55742 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 924) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 158) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4649 (was 4675) 2023-09-27 22:01:39,696 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-27 22:01:39,719 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=168, AvailableMemoryMB=4648 2023-09-27 22:01:39,719 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-27 22:01:39,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:01:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:01:39,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:01:39,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-27 22:01:39,727 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:01:39,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 22:01:39,730 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:39,730 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:39,730 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 empty. 2023-09-27 22:01:39,731 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e empty. 2023-09-27 22:01:39,731 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:39,731 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:39,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 22:01:39,743 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-27 22:01:39,745 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b3affffbd4b920465b0429686a45c21e, NAME => 'testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:39,745 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41294b8f96d113d6bccbc669ae3fcaa7, NAME => 'testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 41294b8f96d113d6bccbc669ae3fcaa7, disabling compactions & flushes 2023-09-27 22:01:39,757 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. after waiting 0 ms 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:39,757 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:39,757 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 41294b8f96d113d6bccbc669ae3fcaa7: 2023-09-27 22:01:39,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:39,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b3affffbd4b920465b0429686a45c21e, disabling compactions & flushes 2023-09-27 22:01:39,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:39,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:39,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. after waiting 0 ms 2023-09-27 22:01:39,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:39,764 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:39,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b3affffbd4b920465b0429686a45c21e: 2023-09-27 22:01:39,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:01:39,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852099767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852099767"}]},"ts":"1695852099767"} 2023-09-27 22:01:39,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852099767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852099767"}]},"ts":"1695852099767"} 2023-09-27 22:01:39,770 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:01:39,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:01:39,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852099771"}]},"ts":"1695852099771"} 2023-09-27 22:01:39,772 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-27 22:01:39,775 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:01:39,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:01:39,777 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:01:39,777 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:01:39,777 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:01:39,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, ASSIGN}] 2023-09-27 22:01:39,780 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, ASSIGN 2023-09-27 22:01:39,780 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, ASSIGN 2023-09-27 22:01:39,781 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33753,1695852059101; forceNewPlan=false, retain=false 2023-09-27 22:01:39,781 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:01:39,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 22:01:39,931 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:01:39,934 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41294b8f96d113d6bccbc669ae3fcaa7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:39,934 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b3affffbd4b920465b0429686a45c21e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:39,934 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852099934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852099934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852099934"}]},"ts":"1695852099934"} 2023-09-27 22:01:39,934 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852099934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852099934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852099934"}]},"ts":"1695852099934"} 2023-09-27 22:01:39,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 41294b8f96d113d6bccbc669ae3fcaa7, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:01:39,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure b3affffbd4b920465b0429686a45c21e, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:01:40,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 22:01:40,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41294b8f96d113d6bccbc669ae3fcaa7, NAME => 'testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3affffbd4b920465b0429686a45c21e, NAME => 'testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. service=AccessControlService 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. service=AccessControlService 2023-09-27 22:01:40,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:40,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,094 INFO [StoreOpener-b3affffbd4b920465b0429686a45c21e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,094 INFO [StoreOpener-41294b8f96d113d6bccbc669ae3fcaa7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,095 DEBUG [StoreOpener-b3affffbd4b920465b0429686a45c21e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf 2023-09-27 22:01:40,095 DEBUG [StoreOpener-41294b8f96d113d6bccbc669ae3fcaa7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf 2023-09-27 22:01:40,095 DEBUG [StoreOpener-41294b8f96d113d6bccbc669ae3fcaa7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf 2023-09-27 22:01:40,095 DEBUG [StoreOpener-b3affffbd4b920465b0429686a45c21e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf 2023-09-27 22:01:40,096 INFO [StoreOpener-b3affffbd4b920465b0429686a45c21e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3affffbd4b920465b0429686a45c21e columnFamilyName cf 2023-09-27 22:01:40,096 INFO [StoreOpener-41294b8f96d113d6bccbc669ae3fcaa7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41294b8f96d113d6bccbc669ae3fcaa7 columnFamilyName cf 2023-09-27 22:01:40,097 INFO [StoreOpener-b3affffbd4b920465b0429686a45c21e-1] regionserver.HStore(310): Store=b3affffbd4b920465b0429686a45c21e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:40,097 INFO [StoreOpener-41294b8f96d113d6bccbc669ae3fcaa7-1] regionserver.HStore(310): Store=41294b8f96d113d6bccbc669ae3fcaa7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:01:40,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:01:40,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b3affffbd4b920465b0429686a45c21e 2023-09-27 22:01:40,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:40,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:01:40,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41294b8f96d113d6bccbc669ae3fcaa7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69308070, jitterRate=0.03277072310447693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:40,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41294b8f96d113d6bccbc669ae3fcaa7: 2023-09-27 22:01:40,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b3affffbd4b920465b0429686a45c21e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63347547, jitterRate=-0.056047990918159485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:01:40,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b3affffbd4b920465b0429686a45c21e: 2023-09-27 22:01:40,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7., pid=45, masterSystemTime=1695852100088 2023-09-27 22:01:40,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41294b8f96d113d6bccbc669ae3fcaa7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,108 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852100107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852100107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852100107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852100107"}]},"ts":"1695852100107"} 2023-09-27 22:01:40,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e., pid=46, masterSystemTime=1695852100088 2023-09-27 22:01:40,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b3affffbd4b920465b0429686a45c21e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852100111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852100111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852100111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852100111"}]},"ts":"1695852100111"} 2023-09-27 22:01:40,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-27 22:01:40,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 41294b8f96d113d6bccbc669ae3fcaa7, server=jenkins-hbase4.apache.org,32927,1695852059054 in 173 msec 2023-09-27 22:01:40,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, ASSIGN in 335 msec 2023-09-27 22:01:40,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-27 22:01:40,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure b3affffbd4b920465b0429686a45c21e, server=jenkins-hbase4.apache.org,33753,1695852059101 in 176 msec 2023-09-27 22:01:40,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-27 22:01:40,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, ASSIGN in 338 msec 2023-09-27 22:01:40,118 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:01:40,118 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852100118"}]},"ts":"1695852100118"} 2023-09-27 22:01:40,119 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-27 22:01:40,122 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:01:40,123 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-27 22:01:40,124 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 22:01:40,126 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:40,126 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:40,126 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:40,126 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:01:40,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:40,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:40,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:40,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 22:01:40,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 407 msec 2023-09-27 22:01:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 22:01:40,330 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-27 22:01:40,333 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 22:01:40,333 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,335 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:40,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852100348 (current time:1695852100348). 2023-09-27 22:01:40,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:40,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x1bd22500 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:40,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48aa9a30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:40,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:40,359 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:40,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bd22500 to 127.0.0.1:51065 2023-09-27 22:01:40,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:40,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x56b71ef9 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:40,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc7cb0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:40,368 DEBUG [hconnection-0x40a0b1b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:40,370 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:40,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56b71ef9 to 127.0.0.1:51065 2023-09-27 22:01:40,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:40,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 22:01:40,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:40,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,378 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,379 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695852700379 2023-09-27 22:01:40,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 22:01:40,380 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:40,380 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:40,383 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-27 22:01:40,385 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,386 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695852700386 2023-09-27 22:01:40,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,395 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-27 22:01:40,395 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,396 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 22:01:40,396 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 22:01:40,397 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,397 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,398 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,398 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,398 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,398 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,399 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 22:01:40,400 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,400 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 22:01:40,401 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,401 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,402 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,402 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,402 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,402 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,402 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,405 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,405 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,407 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,407 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3af6f163[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 22:01:40,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3af6f163[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:40,411 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 22:01:40,411 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:40,414 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,414 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. started... 2023-09-27 22:01:40,414 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:40,414 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3affffbd4b920465b0429686a45c21e: 2023-09-27 22:01:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,414 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. started... 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:40,415 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41294b8f96d113d6bccbc669ae3fcaa7: 2023-09-27 22:01:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,415 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,415 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:40,416 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:40,417 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:01:40,424 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,424 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,424 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,428 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. completed. 2023-09-27 22:01:40,428 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,428 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. completed. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,428 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:40,430 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,430 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,430 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,430 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,431 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,431 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,431 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,431 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:01:40,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 22:01:40,438 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-27 22:01:40,438 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:40,438 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:40,438 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,438 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,440 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,441 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,444 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,444 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,445 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 22:01:40,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,448 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,448 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,450 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:40,450 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,450 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,450 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,450 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:01:40,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,480 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:40,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 22:01:40,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:40,482 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:40,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 22:01:40,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,486 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 22:01:40,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695852100379Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695852100463 (+84 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695852100463Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695852100463Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695852100469 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695852100479 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695852100485 (+6 ms) 2023-09-27 22:01:40,488 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 108 msec 2023-09-27 22:01:40,682 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:40,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 22:01:40,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:40,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:40,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33753] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:01:40,690 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 22:01:40,691 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,691 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:01:40,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852100701 (current time:1695852100701). 2023-09-27 22:01:40,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:01:40,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x317ec5b9 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:40,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f3daf5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:40,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:40,717 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:40,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x317ec5b9 to 127.0.0.1:51065 2023-09-27 22:01:40,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:40,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x5834f1df to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:01:40,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f20a46d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:01:40,726 DEBUG [hconnection-0x2d55b781-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:01:40,727 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:01:40,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5834f1df to 127.0.0.1:51065 2023-09-27 22:01:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:01:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 22:01:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:01:40,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,736 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,737 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695852700737 2023-09-27 22:01:40,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 22:01:40,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 22:01:40,738 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:01:40,738 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:01:40,742 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 22:01:40,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-27 22:01:40,744 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,745 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695852700745 2023-09-27 22:01:40,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-27 22:01:40,759 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-27 22:01:40,759 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,760 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 22:01:40,760 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 22:01:40,760 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,761 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,762 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,762 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,762 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,763 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,763 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,763 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:01:40,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 22:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 22:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 22:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 22:01:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:01:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,768 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 22:01:40,768 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 22:01:40,768 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,768 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 22:01:40,770 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,771 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,771 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:01:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b9c7999[Count = 1] remaining members to acquire global barrier 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 22:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b9c7999[Count = 0] remaining members to acquire global barrier 2023-09-27 22:01:40,777 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 22:01:40,777 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,784 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,785 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. started... 2023-09-27 22:01:40,785 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,785 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:01:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,785 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b3affffbd4b920465b0429686a45c21e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 22:01:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 22:01:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:01:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:01:40,785 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,785 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. started... 2023-09-27 22:01:40,785 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41294b8f96d113d6bccbc669ae3fcaa7 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 22:01:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,812 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f 2023-09-27 22:01:40,820 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6 2023-09-27 22:01:40,833 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/.tmp/cf/7b197f960dd04e8997bbe80a32da8765 2023-09-27 22:01:40,838 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/.tmp/cf/7b197f960dd04e8997bbe80a32da8765 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765 2023-09-27 22:01:40,838 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 22:01:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:01:40,840 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/.tmp/cf/cc8ff26f7f6044b892ccfca7c29df9a2 2023-09-27 22:01:40,840 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:01:40,844 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 22:01:40,845 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 41294b8f96d113d6bccbc669ae3fcaa7 in 60ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:40,845 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 22:01:40,845 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/.tmp/cf/cc8ff26f7f6044b892ccfca7c29df9a2 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2 2023-09-27 22:01:40,846 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41294b8f96d113d6bccbc669ae3fcaa7: 2023-09-27 22:01:40,846 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 22:01:40,846 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:40,846 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765] hfiles 2023-09-27 22:01:40,846 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 22:01:40,851 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2, entries=47, sequenceid=6, filesize=12.7 K 2023-09-27 22:01:40,852 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b3affffbd4b920465b0429686a45c21e in 67ms, sequenceid=6, compaction requested=false 2023-09-27 22:01:40,853 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3affffbd4b920465b0429686a45c21e: 2023-09-27 22:01:40,854 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 22:01:40,854 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:01:40,854 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2] hfiles 2023-09-27 22:01:40,854 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 22:01:40,857 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. completed. 2023-09-27 22:01:40,857 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:01:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:40,858 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:40,858 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,858 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,858 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:01:40,859 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,859 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,859 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,860 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,863 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. completed. 2023-09-27 22:01:40,863 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:01:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:01:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:01:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 22:01:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:01:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,865 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,865 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 22:01:40,865 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,865 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:01:40,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 22:01:40,870 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-27 22:01:40,870 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:01:40,870 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:01:40,870 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-27 22:01:40,870 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:01:40,873 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,874 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,874 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:01:40,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,876 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,877 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:01:40,877 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 22:01:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:01:40,883 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:01:40,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:01:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,883 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:01:40,885 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:01:40,885 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 22:01:40,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:01:40,885 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:01:40,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 22:01:40,885 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:01:40,886 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:01:40,886 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:01:40,886 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,886 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f] mob files 2023-09-27 22:01:40,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6 2023-09-27 22:01:40,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f 2023-09-27 22:01:40,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-27 22:01:40,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 22:01:40,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,920 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:40,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695852100737Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695852100899 (+162 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695852100899Loading Region manifests for snaptb0-testConsecutiveExports at 1695852100899Writing data manifest for snaptb0-testConsecutiveExports at 1695852100903 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695852100911 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695852100919 (+8 ms) 2023-09-27 22:01:40,923 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 22:01:40,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-09-27 22:01:41,040 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:01:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 22:01:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:01:41,042 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042 2023-09-27 22:01:41,042 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:41,063 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:41,063 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4722d792, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:41,063 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 22:01:41,071 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:41,082 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:41,083 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:41,083 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:41,083 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:41,968 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-2097930697335816046.jar 2023-09-27 22:01:41,969 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:41,969 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,035 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-8978592131901541880.jar 2023-09-27 22:01:42,036 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,036 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,036 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,037 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,037 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,037 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:42,038 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:01:42,038 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:01:42,039 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:01:42,039 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:01:42,039 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:01:42,040 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:01:42,040 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:01:42,040 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:01:42,041 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:01:42,041 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:01:42,042 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:42,042 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:42,043 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:42,043 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:42,043 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:42,044 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:42,044 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:42,406 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:01:42,408 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 22:01:42,410 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 22:01:44,090 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:44,090 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:44,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0002_000001 (auth:SIMPLE) 2023-09-27 22:01:44,925 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0003_000001 (auth:SIMPLE) 2023-09-27 22:01:44,993 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:01:48,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0003_000001 (auth:SIMPLE) 2023-09-27 22:01:50,857 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0003_000001 (auth:SIMPLE) 2023-09-27 22:01:53,186 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0003_000001 (auth:SIMPLE) 2023-09-27 22:01:54,574 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:01:54,575 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:01:54,579 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 22:01:54,579 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:01:54,580 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:01:54,580 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 22:01:54,582 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 22:01:54,582 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 22:01:54,582 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 22:01:54,583 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 22:01:54,583 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 22:01:54,584 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:54,605 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:01:54,605 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6944d8de, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:54,605 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 22:01:54,616 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 22:01:54,627 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:54,627 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:54,628 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:54,628 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,493 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-6128560697241822043.jar 2023-09-27 22:01:55,493 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,494 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,560 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-3814482215521829723.jar 2023-09-27 22:01:55,560 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,560 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,561 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,561 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,562 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,562 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:01:55,562 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:01:55,563 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:01:55,563 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:01:55,563 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:01:55,564 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:01:55,564 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:01:55,565 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:01:55,565 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:01:55,565 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:01:55,566 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:01:55,566 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:55,567 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:55,567 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:55,567 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:55,568 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:01:55,568 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:55,569 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:01:55,946 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:01:55,949 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 22:01:55,951 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 22:01:59,357 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:59,358 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:01:59,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0003_000001 (auth:SIMPLE) 2023-09-27 22:02:00,102 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0004_000001 (auth:SIMPLE) 2023-09-27 22:02:03,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0004_000001 (auth:SIMPLE) 2023-09-27 22:02:05,895 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0004_000001 (auth:SIMPLE) 2023-09-27 22:02:08,089 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0004_000001 (auth:SIMPLE) 2023-09-27 22:02:10,124 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:02:10,124 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:02:10,127 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 22:02:10,127 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:02:10,128 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:02:10,128 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 22:02:10,131 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 22:02:10,131 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 22:02:10,131 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 22:02:10,132 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 22:02:10,132 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/local-export-1695852101042/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 22:02:10,144 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-27 22:02:10,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-27 22:02:10,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 22:02:10,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852130148"}]},"ts":"1695852130148"} 2023-09-27 22:02:10,150 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-27 22:02:10,151 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-27 22:02:10,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, UNASSIGN}] 2023-09-27 22:02:10,154 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, UNASSIGN 2023-09-27 22:02:10,154 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, UNASSIGN 2023-09-27 22:02:10,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41294b8f96d113d6bccbc669ae3fcaa7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:10,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852130154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852130154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852130154"}]},"ts":"1695852130154"} 2023-09-27 22:02:10,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b3affffbd4b920465b0429686a45c21e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:10,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852130155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852130155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852130155"}]},"ts":"1695852130155"} 2023-09-27 22:02:10,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 41294b8f96d113d6bccbc669ae3fcaa7, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:10,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure b3affffbd4b920465b0429686a45c21e, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:10,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 22:02:10,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b3affffbd4b920465b0429686a45c21e 2023-09-27 22:02:10,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:02:10,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b3affffbd4b920465b0429686a45c21e, disabling compactions & flushes 2023-09-27 22:02:10,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41294b8f96d113d6bccbc669ae3fcaa7, disabling compactions & flushes 2023-09-27 22:02:10,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:02:10,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. after waiting 0 ms 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. after waiting 0 ms 2023-09-27 22:02:10,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:02:10,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:10,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:10,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:10,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:10,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7. 2023-09-27 22:02:10,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e. 2023-09-27 22:02:10,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41294b8f96d113d6bccbc669ae3fcaa7: 2023-09-27 22:02:10,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b3affffbd4b920465b0429686a45c21e: 2023-09-27 22:02:10,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:02:10,322 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41294b8f96d113d6bccbc669ae3fcaa7, regionState=CLOSED 2023-09-27 22:02:10,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b3affffbd4b920465b0429686a45c21e 2023-09-27 22:02:10,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852130322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852130322"}]},"ts":"1695852130322"} 2023-09-27 22:02:10,322 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b3affffbd4b920465b0429686a45c21e, regionState=CLOSED 2023-09-27 22:02:10,322 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695852130322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852130322"}]},"ts":"1695852130322"} 2023-09-27 22:02:10,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-27 22:02:10,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 41294b8f96d113d6bccbc669ae3fcaa7, server=jenkins-hbase4.apache.org,32927,1695852059054 in 167 msec 2023-09-27 22:02:10,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-27 22:02:10,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure b3affffbd4b920465b0429686a45c21e, server=jenkins-hbase4.apache.org,33753,1695852059101 in 167 msec 2023-09-27 22:02:10,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41294b8f96d113d6bccbc669ae3fcaa7, UNASSIGN in 173 msec 2023-09-27 22:02:10,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-27 22:02:10,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b3affffbd4b920465b0429686a45c21e, UNASSIGN in 174 msec 2023-09-27 22:02:10,329 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852130328"}]},"ts":"1695852130328"} 2023-09-27 22:02:10,330 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-27 22:02:10,332 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-27 22:02:10,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-09-27 22:02:10,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 22:02:10,450 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-27 22:02:10,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-27 22:02:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-27 22:02:10,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,457 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-27 22:02:10,460 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,460 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,460 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,460 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,460 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:02:10,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:02:10,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 22:02:10,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 22:02:10,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 22:02:10,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 22:02:10,461 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:10,461 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 22:02:10,462 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:10,463 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/recovered.edits] 2023-09-27 22:02:10,463 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/recovered.edits] 2023-09-27 22:02:10,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 22:02:10,467 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/cf/7b197f960dd04e8997bbe80a32da8765 2023-09-27 22:02:10,467 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/cf/cc8ff26f7f6044b892ccfca7c29df9a2 2023-09-27 22:02:10,471 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7/recovered.edits/9.seqid 2023-09-27 22:02:10,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e/recovered.edits/9.seqid 2023-09-27 22:02:10,471 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/41294b8f96d113d6bccbc669ae3fcaa7 2023-09-27 22:02:10,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testConsecutiveExports/b3affffbd4b920465b0429686a45c21e 2023-09-27 22:02:10,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 22:02:10,472 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 22:02:10,473 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-27 22:02:10,477 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092754c2eddb609a4b699a79440e9891c4f6 2023-09-27 22:02:10,478 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309277abbcb6474c6473d9cdd6fd9915fa98f 2023-09-27 22:02:10,479 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 22:02:10,481 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,483 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-27 22:02:10,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-27 22:02:10,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-27 22:02:10,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852130486"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:10,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852130486"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:10,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:02:10,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41294b8f96d113d6bccbc669ae3fcaa7, NAME => 'testtb-testConsecutiveExports,,1695852099721.41294b8f96d113d6bccbc669ae3fcaa7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b3affffbd4b920465b0429686a45c21e, NAME => 'testtb-testConsecutiveExports,1,1695852099721.b3affffbd4b920465b0429686a45c21e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:02:10,488 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-27 22:02:10,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852130488"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:10,490 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-27 22:02:10,493 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 22:02:10,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-27 22:02:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 22:02:10,564 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-27 22:02:10,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-27 22:02:10,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-27 22:02:10,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-27 22:02:10,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-27 22:02:10,599 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 763), OpenFileDescriptor=902 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 195), ProcessCount=168 (was 168), AvailableMemoryMB=4541 (was 4648) 2023-09-27 22:02:10,599 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 22:02:10,617 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=138, ProcessCount=168, AvailableMemoryMB=4540 2023-09-27 22:02:10,618 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 22:02:10,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:02:10,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:10,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:02:10,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-27 22:02:10,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:02:10,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 22:02:10,626 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,626 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,626 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 empty. 2023-09-27 22:02:10,626 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c empty. 2023-09-27 22:02:10,627 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,627 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,627 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 22:02:10,640 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-27 22:02:10,641 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c361d63d2f1d72aae9c6cd7eb7ba9894, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:10,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 041a7d808715c1286072dcb4078e055c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c361d63d2f1d72aae9c6cd7eb7ba9894, disabling compactions & flushes 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 041a7d808715c1286072dcb4078e055c, disabling compactions & flushes 2023-09-27 22:02:10,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:10,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:10,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. after waiting 0 ms 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. after waiting 0 ms 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:10,653 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:10,653 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 041a7d808715c1286072dcb4078e055c: 2023-09-27 22:02:10,653 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c361d63d2f1d72aae9c6cd7eb7ba9894: 2023-09-27 22:02:10,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:02:10,656 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852130656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852130656"}]},"ts":"1695852130656"} 2023-09-27 22:02:10,656 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852130656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852130656"}]},"ts":"1695852130656"} 2023-09-27 22:02:10,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:02:10,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:02:10,666 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852130666"}]},"ts":"1695852130666"} 2023-09-27 22:02:10,667 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-27 22:02:10,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:02:10,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:02:10,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:02:10,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:02:10,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:02:10,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, ASSIGN}] 2023-09-27 22:02:10,673 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, ASSIGN 2023-09-27 22:02:10,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, ASSIGN 2023-09-27 22:02:10,674 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:02:10,674 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33753,1695852059101; forceNewPlan=false, retain=false 2023-09-27 22:02:10,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 22:02:10,825 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:02:10,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=041a7d808715c1286072dcb4078e055c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:10,827 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c361d63d2f1d72aae9c6cd7eb7ba9894, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:10,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852130827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852130827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852130827"}]},"ts":"1695852130827"} 2023-09-27 22:02:10,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852130827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852130827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852130827"}]},"ts":"1695852130827"} 2023-09-27 22:02:10,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 041a7d808715c1286072dcb4078e055c, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:10,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure c361d63d2f1d72aae9c6cd7eb7ba9894, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 22:02:10,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:10,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c361d63d2f1d72aae9c6cd7eb7ba9894, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:02:10,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:10,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. service=AccessControlService 2023-09-27 22:02:10,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 041a7d808715c1286072dcb4078e055c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:02:10,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. service=AccessControlService 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,986 INFO [StoreOpener-c361d63d2f1d72aae9c6cd7eb7ba9894-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,986 INFO [StoreOpener-041a7d808715c1286072dcb4078e055c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,988 DEBUG [StoreOpener-c361d63d2f1d72aae9c6cd7eb7ba9894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf 2023-09-27 22:02:10,988 DEBUG [StoreOpener-c361d63d2f1d72aae9c6cd7eb7ba9894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf 2023-09-27 22:02:10,988 DEBUG [StoreOpener-041a7d808715c1286072dcb4078e055c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf 2023-09-27 22:02:10,988 DEBUG [StoreOpener-041a7d808715c1286072dcb4078e055c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf 2023-09-27 22:02:10,989 INFO [StoreOpener-041a7d808715c1286072dcb4078e055c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 041a7d808715c1286072dcb4078e055c columnFamilyName cf 2023-09-27 22:02:10,989 INFO [StoreOpener-c361d63d2f1d72aae9c6cd7eb7ba9894-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c361d63d2f1d72aae9c6cd7eb7ba9894 columnFamilyName cf 2023-09-27 22:02:10,991 INFO [StoreOpener-041a7d808715c1286072dcb4078e055c-1] regionserver.HStore(310): Store=041a7d808715c1286072dcb4078e055c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:10,991 INFO [StoreOpener-c361d63d2f1d72aae9c6cd7eb7ba9894-1] regionserver.HStore(310): Store=c361d63d2f1d72aae9c6cd7eb7ba9894/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:10,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:10,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:10,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:10,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:10,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c361d63d2f1d72aae9c6cd7eb7ba9894; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70631947, jitterRate=0.05249802768230438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:10,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 041a7d808715c1286072dcb4078e055c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68451732, jitterRate=0.020010292530059814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:10,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c361d63d2f1d72aae9c6cd7eb7ba9894: 2023-09-27 22:02:10,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 041a7d808715c1286072dcb4078e055c: 2023-09-27 22:02:10,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c., pid=60, masterSystemTime=1695852130981 2023-09-27 22:02:10,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894., pid=61, masterSystemTime=1695852130981 2023-09-27 22:02:10,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=041a7d808715c1286072dcb4078e055c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852131000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852131000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852131000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852131000"}]},"ts":"1695852131000"} 2023-09-27 22:02:11,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c361d63d2f1d72aae9c6cd7eb7ba9894, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852131001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852131001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852131001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852131001"}]},"ts":"1695852131001"} 2023-09-27 22:02:11,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-27 22:02:11,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 041a7d808715c1286072dcb4078e055c, server=jenkins-hbase4.apache.org,32927,1695852059054 in 173 msec 2023-09-27 22:02:11,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-27 22:02:11,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure c361d63d2f1d72aae9c6cd7eb7ba9894, server=jenkins-hbase4.apache.org,33753,1695852059101 in 173 msec 2023-09-27 22:02:11,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, ASSIGN in 333 msec 2023-09-27 22:02:11,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-27 22:02:11,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, ASSIGN in 334 msec 2023-09-27 22:02:11,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:02:11,007 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852131007"}]},"ts":"1695852131007"} 2023-09-27 22:02:11,008 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-27 22:02:11,012 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:02:11,012 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-27 22:02:11,014 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 22:02:11,015 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:11,015 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:11,015 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:11,015 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:11,016 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:11,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:11,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:11,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:11,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 397 msec 2023-09-27 22:02:11,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 22:02:11,227 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-27 22:02:11,229 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,229 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,231 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:11,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852131244 (current time:1695852131244). 2023-09-27 22:02:11,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:11,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x3a278d99 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:11,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e440d06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:11,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:11,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:11,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a278d99 to 127.0.0.1:51065 2023-09-27 22:02:11,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:11,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x34285020 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:11,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32e55879, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:11,265 DEBUG [hconnection-0x2c575f1e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:11,267 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:11,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34285020 to 127.0.0.1:51065 2023-09-27 22:02:11,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:11,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 22:02:11,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:11,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,278 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,279 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695852731279 2023-09-27 22:02:11,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,280 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:11,280 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:11,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,282 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-27 22:02:11,284 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,284 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695852731284 2023-09-27 22:02:11,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,298 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 22:02:11,298 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,299 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 22:02:11,299 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 22:02:11,300 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,300 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,302 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,302 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,302 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,302 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,302 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,303 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,303 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,304 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,305 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 22:02:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,305 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,305 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,305 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,305 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,307 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,307 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,307 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,309 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,309 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,309 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,309 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,309 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,309 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,310 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,310 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,310 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,310 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b192fa5[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 22:02:11,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b192fa5[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:11,313 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 22:02:11,313 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,314 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,314 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,314 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,315 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:11,315 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. started... 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:11,315 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,315 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:11,315 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c361d63d2f1d72aae9c6cd7eb7ba9894: 2023-09-27 22:02:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:11,315 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,316 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,316 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. started... 2023-09-27 22:02:11,316 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:11,316 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 041a7d808715c1286072dcb4078e055c: 2023-09-27 22:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,324 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. completed. 2023-09-27 22:02:11,324 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,324 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:11,325 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. completed. 2023-09-27 22:02:11,325 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,326 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,326 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:11,326 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,326 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,326 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,326 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,327 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,327 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,327 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,327 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:02:11,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 22:02:11,334 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 22:02:11,334 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:11,334 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:11,334 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,334 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,335 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,336 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,337 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,337 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,339 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,339 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,340 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,344 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,344 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,345 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:02:11,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 22:02:11,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,380 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695852131279Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695852131361 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695852131361Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695852131361Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695852131365 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695852131374 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695852131379 (+5 ms) 2023-09-27 22:02:11,381 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:11,382 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 22:02:11,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:11,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 102 msec 2023-09-27 22:02:11,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33753] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:11,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:11,390 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,390 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,390 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:11,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852131399 (current time:1695852131399). 2023-09-27 22:02:11,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:11,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x02be0012 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:11,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a8ba6ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:11,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:11,408 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02be0012 to 127.0.0.1:51065 2023-09-27 22:02:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:11,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x27e37c7c to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:11,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55af5602, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:11,416 DEBUG [hconnection-0x42042e86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:11,418 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:11,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27e37c7c to 127.0.0.1:51065 2023-09-27 22:02:11,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:11,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 22:02:11,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:11,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,425 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,426 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695852731426 2023-09-27 22:02:11,426 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 22:02:11,427 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:11,427 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:11,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,428 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 22:02:11,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-27 22:02:11,430 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,431 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695852731431 2023-09-27 22:02:11,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,441 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 22:02:11,441 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 22:02:11,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 22:02:11,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,442 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,444 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,444 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,444 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,444 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,445 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 22:02:11,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,446 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,446 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,446 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 22:02:11,447 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,447 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,446 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,447 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,447 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,449 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 22:02:11,449 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 22:02:11,449 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 22:02:11,450 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,451 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,451 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,452 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4979419a[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 22:02:11,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4979419a[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:11,455 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 22:02:11,455 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,458 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,458 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,458 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:11,459 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,459 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:11,459 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. started... 2023-09-27 22:02:11,459 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,459 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:11,459 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:11,459 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 041a7d808715c1286072dcb4078e055c 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-27 22:02:11,459 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. started... 2023-09-27 22:02:11,460 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c361d63d2f1d72aae9c6cd7eb7ba9894 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-27 22:02:11,460 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,460 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,460 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,487 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c 2023-09-27 22:02:11,487 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071 2023-09-27 22:02:11,504 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/.tmp/cf/86cfc08b5cc349efb49fbbbb8c87b751 2023-09-27 22:02:11,504 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/.tmp/cf/d221991ca3404824899a770ad14932eb 2023-09-27 22:02:11,509 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/.tmp/cf/86cfc08b5cc349efb49fbbbb8c87b751 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751 2023-09-27 22:02:11,509 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/.tmp/cf/d221991ca3404824899a770ad14932eb as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb 2023-09-27 22:02:11,514 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751, entries=49, sequenceid=6, filesize=13.9 K 2023-09-27 22:02:11,514 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb, entries=1, sequenceid=6, filesize=5.1 K 2023-09-27 22:02:11,515 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 041a7d808715c1286072dcb4078e055c in 56ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:11,515 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 22:02:11,515 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for c361d63d2f1d72aae9c6cd7eb7ba9894 in 55ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:11,515 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c361d63d2f1d72aae9c6cd7eb7ba9894: 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 041a7d808715c1286072dcb4078e055c: 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:11,518 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:11,519 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb] hfiles 2023-09-27 22:02:11,519 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751] hfiles 2023-09-27 22:02:11,519 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,519 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,527 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. completed. 2023-09-27 22:02:11,527 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:11,527 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. completed. 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:11,528 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 22:02:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:02:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:02:11,531 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,533 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 22:02:11,533 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,533 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,533 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 22:02:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:02:11,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 22:02:11,539 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 22:02:11,539 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:11,539 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:11,539 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,539 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:11,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,545 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,546 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,548 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,548 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:11,549 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,551 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,551 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:11,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:11,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,552 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:11,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:11,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:11,553 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,553 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,553 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,554 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c] mob files 2023-09-27 22:02:11,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071 2023-09-27 22:02:11,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c 2023-09-27 22:02:11,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 22:02:11,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,581 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:11,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695852131426Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695852131563 (+137 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695852131563Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695852131563Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695852131566 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695852131573 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695852131580 (+7 ms) 2023-09-27 22:02:11,582 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 22:02:11,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 156 msec 2023-09-27 22:02:11,729 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:11,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 22:02:11,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:11,757 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:02:11,762 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:02:11,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 22:02:11,764 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:02:11,768 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:02:11,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33753] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 22:02:11,769 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 22:02:11,772 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 22:02:11,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40159] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 22:02:11,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 22:02:11,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:11,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:02:11,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-27 22:02:11,778 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:02:11,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 22:02:11,780 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:11,780 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:11,781 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae empty. 2023-09-27 22:02:11,781 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 empty. 2023-09-27 22:02:11,781 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:11,781 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:11,781 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 22:02:11,791 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-27 22:02:11,792 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5ba7f357509bc612f942e2255639f8ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:11,792 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => f9b07054cfa4e20ccfdddf62a6e5a519, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:11,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5ba7f357509bc612f942e2255639f8ae, disabling compactions & flushes 2023-09-27 22:02:11,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. after waiting 0 ms 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:11,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5ba7f357509bc612f942e2255639f8ae: 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing f9b07054cfa4e20ccfdddf62a6e5a519, disabling compactions & flushes 2023-09-27 22:02:11,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. after waiting 0 ms 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:11,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:11,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for f9b07054cfa4e20ccfdddf62a6e5a519: 2023-09-27 22:02:11,803 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:02:11,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852131804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852131804"}]},"ts":"1695852131804"} 2023-09-27 22:02:11,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852131804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852131804"}]},"ts":"1695852131804"} 2023-09-27 22:02:11,806 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:02:11,807 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:02:11,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852131807"}]},"ts":"1695852131807"} 2023-09-27 22:02:11,808 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-27 22:02:11,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:02:11,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:02:11,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:02:11,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:02:11,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:02:11,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, ASSIGN}] 2023-09-27 22:02:11,814 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, ASSIGN 2023-09-27 22:02:11,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, ASSIGN 2023-09-27 22:02:11,815 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33753,1695852059101; forceNewPlan=false, retain=false 2023-09-27 22:02:11,815 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:02:11,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 22:02:11,966 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:02:11,968 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5ba7f357509bc612f942e2255639f8ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:11,968 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f9b07054cfa4e20ccfdddf62a6e5a519, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:11,968 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852131968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852131968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852131968"}]},"ts":"1695852131968"} 2023-09-27 22:02:11,968 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852131968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852131968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852131968"}]},"ts":"1695852131968"} 2023-09-27 22:02:11,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 5ba7f357509bc612f942e2255639f8ae, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:11,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure f9b07054cfa4e20ccfdddf62a6e5a519, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:12,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 22:02:12,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ba7f357509bc612f942e2255639f8ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.', STARTKEY => '', ENDKEY => '2'} 2023-09-27 22:02:12,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9b07054cfa4e20ccfdddf62a6e5a519, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.', STARTKEY => '2', ENDKEY => ''} 2023-09-27 22:02:12,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. service=AccessControlService 2023-09-27 22:02:12,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. service=AccessControlService 2023-09-27 22:02:12,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:12,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,127 INFO [StoreOpener-5ba7f357509bc612f942e2255639f8ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,127 INFO [StoreOpener-f9b07054cfa4e20ccfdddf62a6e5a519-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,129 DEBUG [StoreOpener-f9b07054cfa4e20ccfdddf62a6e5a519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf 2023-09-27 22:02:12,129 DEBUG [StoreOpener-5ba7f357509bc612f942e2255639f8ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf 2023-09-27 22:02:12,129 DEBUG [StoreOpener-5ba7f357509bc612f942e2255639f8ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf 2023-09-27 22:02:12,129 DEBUG [StoreOpener-f9b07054cfa4e20ccfdddf62a6e5a519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf 2023-09-27 22:02:12,129 INFO [StoreOpener-5ba7f357509bc612f942e2255639f8ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ba7f357509bc612f942e2255639f8ae columnFamilyName cf 2023-09-27 22:02:12,129 INFO [StoreOpener-f9b07054cfa4e20ccfdddf62a6e5a519-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9b07054cfa4e20ccfdddf62a6e5a519 columnFamilyName cf 2023-09-27 22:02:12,130 INFO [StoreOpener-5ba7f357509bc612f942e2255639f8ae-1] regionserver.HStore(310): Store=5ba7f357509bc612f942e2255639f8ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:12,130 INFO [StoreOpener-f9b07054cfa4e20ccfdddf62a6e5a519-1] regionserver.HStore(310): Store=f9b07054cfa4e20ccfdddf62a6e5a519/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:12,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:12,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9b07054cfa4e20ccfdddf62a6e5a519; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66091909, jitterRate=-0.015153810381889343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:12,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5ba7f357509bc612f942e2255639f8ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64377456, jitterRate=-0.04070115089416504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:12,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9b07054cfa4e20ccfdddf62a6e5a519: 2023-09-27 22:02:12,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5ba7f357509bc612f942e2255639f8ae: 2023-09-27 22:02:12,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae., pid=69, masterSystemTime=1695852132121 2023-09-27 22:02:12,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519., pid=70, masterSystemTime=1695852132122 2023-09-27 22:02:12,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,139 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5ba7f357509bc612f942e2255639f8ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:12,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,139 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852132139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852132139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852132139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852132139"}]},"ts":"1695852132139"} 2023-09-27 22:02:12,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f9b07054cfa4e20ccfdddf62a6e5a519, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:12,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852132140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852132140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852132140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852132140"}]},"ts":"1695852132140"} 2023-09-27 22:02:12,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-27 22:02:12,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 5ba7f357509bc612f942e2255639f8ae, server=jenkins-hbase4.apache.org,32927,1695852059054 in 171 msec 2023-09-27 22:02:12,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-27 22:02:12,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, ASSIGN in 331 msec 2023-09-27 22:02:12,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure f9b07054cfa4e20ccfdddf62a6e5a519, server=jenkins-hbase4.apache.org,33753,1695852059101 in 171 msec 2023-09-27 22:02:12,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-27 22:02:12,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, ASSIGN in 333 msec 2023-09-27 22:02:12,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:02:12,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852132147"}]},"ts":"1695852132147"} 2023-09-27 22:02:12,148 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-27 22:02:12,151 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:02:12,151 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-27 22:02:12,153 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 22:02:12,156 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:12,156 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:12,156 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:12,156 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:12,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:12,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-27 22:02:12,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 22:02:12,381 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-27 22:02:12,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519], force=true 2023-09-27 22:02:12,412 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519], force=true 2023-09-27 22:02:12,412 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519], force=true 2023-09-27 22:02:12,412 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519], force=true 2023-09-27 22:02:12,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 22:02:12,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, UNASSIGN}] 2023-09-27 22:02:12,433 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, UNASSIGN 2023-09-27 22:02:12,433 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, UNASSIGN 2023-09-27 22:02:12,434 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f9b07054cfa4e20ccfdddf62a6e5a519, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:12,434 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5ba7f357509bc612f942e2255639f8ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:12,434 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852132434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852132434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852132434"}]},"ts":"1695852132434"} 2023-09-27 22:02:12,434 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852132434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852132434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852132434"}]},"ts":"1695852132434"} 2023-09-27 22:02:12,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure f9b07054cfa4e20ccfdddf62a6e5a519, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:12,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 5ba7f357509bc612f942e2255639f8ae, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:12,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 22:02:12,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:12,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:12,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9b07054cfa4e20ccfdddf62a6e5a519, disabling compactions & flushes 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5ba7f357509bc612f942e2255639f8ae, disabling compactions & flushes 2023-09-27 22:02:12,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. after waiting 0 ms 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. after waiting 0 ms 2023-09-27 22:02:12,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:12,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f9b07054cfa4e20ccfdddf62a6e5a519 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 22:02:12,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5ba7f357509bc612f942e2255639f8ae 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 22:02:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 22:02:12,817 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 22:02:13,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/.tmp/cf/0c1fbb98a6a64f638b519b6b0072fb55 2023-09-27 22:02:13,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/.tmp/cf/016b8b4191c4469cbdc14a9a55db3f65 2023-09-27 22:02:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/.tmp/cf/0c1fbb98a6a64f638b519b6b0072fb55 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55 2023-09-27 22:02:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/.tmp/cf/016b8b4191c4469cbdc14a9a55db3f65 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65 2023-09-27 22:02:13,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 22:02:13,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 22:02:13,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5ba7f357509bc612f942e2255639f8ae in 423ms, sequenceid=5, compaction requested=false 2023-09-27 22:02:13,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f9b07054cfa4e20ccfdddf62a6e5a519 in 423ms, sequenceid=5, compaction requested=false 2023-09-27 22:02:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 22:02:13,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 22:02:13,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 22:02:13,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:13,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:13,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519. 2023-09-27 22:02:13,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae. 2023-09-27 22:02:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9b07054cfa4e20ccfdddf62a6e5a519: 2023-09-27 22:02:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5ba7f357509bc612f942e2255639f8ae: 2023-09-27 22:02:13,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:13,025 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f9b07054cfa4e20ccfdddf62a6e5a519, regionState=CLOSED 2023-09-27 22:02:13,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:13,025 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852133025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852133025"}]},"ts":"1695852133025"} 2023-09-27 22:02:13,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5ba7f357509bc612f942e2255639f8ae, regionState=CLOSED 2023-09-27 22:02:13,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695852133026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852133026"}]},"ts":"1695852133026"} 2023-09-27 22:02:13,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-27 22:02:13,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure f9b07054cfa4e20ccfdddf62a6e5a519, server=jenkins-hbase4.apache.org,33753,1695852059101 in 592 msec 2023-09-27 22:02:13,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-27 22:02:13,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 5ba7f357509bc612f942e2255639f8ae, server=jenkins-hbase4.apache.org,32927,1695852059054 in 591 msec 2023-09-27 22:02:13,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9b07054cfa4e20ccfdddf62a6e5a519, UNASSIGN in 597 msec 2023-09-27 22:02:13,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-27 22:02:13,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5ba7f357509bc612f942e2255639f8ae, UNASSIGN in 600 msec 2023-09-27 22:02:13,085 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-27 22:02:13,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131774.5ba7f357509bc612f942e2255639f8ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:13,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695852131774.f9b07054cfa4e20ccfdddf62a6e5a519.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:13,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:13,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, ASSIGN}] 2023-09-27 22:02:13,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, ASSIGN 2023-09-27 22:02:13,150 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:02:13,300 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 22:02:13,302 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=95eea91603e107052232145320945aca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695852133302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852133302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852133302"}]},"ts":"1695852133302"} 2023-09-27 22:02:13,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 95eea91603e107052232145320945aca, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:13,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95eea91603e107052232145320945aca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.', STARTKEY => '', ENDKEY => ''} 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. service=AccessControlService 2023-09-27 22:02:13,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 95eea91603e107052232145320945aca 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 95eea91603e107052232145320945aca 2023-09-27 22:02:13,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 95eea91603e107052232145320945aca 2023-09-27 22:02:13,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/.regioninfo 2023-09-27 22:02:13,469 INFO [StoreOpener-95eea91603e107052232145320945aca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 95eea91603e107052232145320945aca 2023-09-27 22:02:13,470 DEBUG [StoreOpener-95eea91603e107052232145320945aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf 2023-09-27 22:02:13,470 DEBUG [StoreOpener-95eea91603e107052232145320945aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf 2023-09-27 22:02:13,471 INFO [StoreOpener-95eea91603e107052232145320945aca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95eea91603e107052232145320945aca columnFamilyName cf 2023-09-27 22:02:13,499 DEBUG [StoreOpener-95eea91603e107052232145320945aca-1] regionserver.HStore(539): loaded hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/016b8b4191c4469cbdc14a9a55db3f65.5ba7f357509bc612f942e2255639f8ae->hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65-top 2023-09-27 22:02:13,504 DEBUG [StoreOpener-95eea91603e107052232145320945aca-1] regionserver.HStore(539): loaded hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/0c1fbb98a6a64f638b519b6b0072fb55.f9b07054cfa4e20ccfdddf62a6e5a519->hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55-top 2023-09-27 22:02:13,505 INFO [StoreOpener-95eea91603e107052232145320945aca-1] regionserver.HStore(310): Store=95eea91603e107052232145320945aca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:13,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca 2023-09-27 22:02:13,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca 2023-09-27 22:02:13,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 95eea91603e107052232145320945aca 2023-09-27 22:02:13,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 95eea91603e107052232145320945aca; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66179397, jitterRate=-0.013850137591362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:13,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 95eea91603e107052232145320945aca: 2023-09-27 22:02:13,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca., pid=77, masterSystemTime=1695852133456 2023-09-27 22:02:13,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.,because compaction is disabled. 2023-09-27 22:02:13,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:13,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:13,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=95eea91603e107052232145320945aca, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695852133514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852133514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852133514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852133514"}]},"ts":"1695852133514"} 2023-09-27 22:02:13,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-27 22:02:13,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 95eea91603e107052232145320945aca, server=jenkins-hbase4.apache.org,32927,1695852059054 in 211 msec 2023-09-27 22:02:13,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-27 22:02:13,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, ASSIGN in 368 msec 2023-09-27 22:02:13,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5ba7f357509bc612f942e2255639f8ae, f9b07054cfa4e20ccfdddf62a6e5a519], force=true in 1.1130 sec 2023-09-27 22:02:13,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 22:02:13,522 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-27 22:02:13,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 22:02:13,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852133522 (current time:1695852133522). 2023-09-27 22:02:13,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:13,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x43448dfa to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:13,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@775a3b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:13,531 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:13,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43448dfa to 127.0.0.1:51065 2023-09-27 22:02:13,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:13,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x55b51e28 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:13,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32f96239, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:13,540 DEBUG [hconnection-0x14de4ebf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:13,542 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b51e28 to 127.0.0.1:51065 2023-09-27 22:02:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 22:02:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 22:02:13,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 22:02:13,550 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 22:02:13,551 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695852733551 2023-09-27 22:02:13,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 22:02:13,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,554 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:13,555 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:13,555 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 22:02:13,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 22:02:13,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-27 22:02:13,557 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 22:02:13,558 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695852733558 2023-09-27 22:02:13,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,567 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 22:02:13,567 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:13,568 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-27 22:02:13,568 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-27 22:02:13,568 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,568 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,571 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,571 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,571 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,571 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 22:02:13,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 22:02:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 22:02:13,574 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 22:02:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 22:02:13,577 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,579 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:13,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-27 22:02:13,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4409cc3f[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:13,581 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-27 22:02:13,581 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,582 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 22:02:13,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:13,582 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,583 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:13,583 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,583 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. started... 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 22:02:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:13,584 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 95eea91603e107052232145320945aca: 2023-09-27 22:02:13,584 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,584 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:13,584 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/016b8b4191c4469cbdc14a9a55db3f65.5ba7f357509bc612f942e2255639f8ae->hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65-top, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/0c1fbb98a6a64f638b519b6b0072fb55.f9b07054cfa4e20ccfdddf62a6e5a519->hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55-top] hfiles 2023-09-27 22:02:13,584 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/016b8b4191c4469cbdc14a9a55db3f65.5ba7f357509bc612f942e2255639f8ae for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,585 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 22:02:13,585 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:13,585 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/0c1fbb98a6a64f638b519b6b0072fb55.f9b07054cfa4e20ccfdddf62a6e5a519 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,585 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 22:02:13,587 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 22:02:13,587 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:13,587 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 22:02:13,596 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. completed. 2023-09-27 22:02:13,596 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 22:02:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:13,601 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 22:02:13,601 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,601 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,601 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 22:02:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:13,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-27 22:02:13,604 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-27 22:02:13,605 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:13,605 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:13,605 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,605 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:13,606 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,606 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,606 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,606 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:13,606 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,607 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,608 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:13,608 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:13,610 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,610 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,611 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,614 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:13,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,613 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:13,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:13,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,614 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:13,615 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,615 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:13,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-27 22:02:13,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,631 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695852133551Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695852133614 (+63 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695852133614Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695852133617 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695852133624 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695852133631 (+7 ms) 2023-09-27 22:02:13,634 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 22:02:13,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 80 msec 2023-09-27 22:02:13,655 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:13,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-27 22:02:13,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:13,656 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656 2023-09-27 22:02:13,656 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36545, tgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656, rawTgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:13,678 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:13,678 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1644732503_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,678 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-27 22:02:13,689 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:13,704 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:13,704 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:13,705 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:13,705 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,266 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0004_000001 (auth:SIMPLE) 2023-09-27 22:02:14,593 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-3363263215692072828.jar 2023-09-27 22:02:14,593 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,594 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,660 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-8733677833867842445.jar 2023-09-27 22:02:14,660 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,661 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,661 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,661 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,662 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,662 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:14,662 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:02:14,663 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:02:14,663 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:02:14,663 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:02:14,664 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:02:14,664 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:02:14,665 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:02:14,665 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:02:14,665 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:02:14,666 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:02:14,666 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:14,667 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:14,667 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:14,667 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:14,668 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:14,668 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:14,669 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:15,018 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:02:15,021 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-27 22:02:15,023 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-27 22:02:15,076 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:15,077 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:15,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0005_000001 (auth:SIMPLE) 2023-09-27 22:02:15,920 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:02:19,020 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0005_000001 (auth:SIMPLE) 2023-09-27 22:02:21,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0005_000001 (auth:SIMPLE) 2023-09-27 22:02:23,534 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0005_000001 (auth:SIMPLE) 2023-09-27 22:02:25,220 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:02:25,226 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:02:25,234 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,234 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:02:25,234 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:02:25,234 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,235 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 22:02:25,235 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 22:02:25,235 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,235 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 22:02:25,236 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852133656/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 22:02:25,242 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 22:02:25,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852145246"}]},"ts":"1695852145246"} 2023-09-27 22:02:25,247 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-27 22:02:25,249 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-27 22:02:25,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, UNASSIGN}] 2023-09-27 22:02:25,251 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, UNASSIGN 2023-09-27 22:02:25,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=95eea91603e107052232145320945aca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:25,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695852145252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852145252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852145252"}]},"ts":"1695852145252"} 2023-09-27 22:02:25,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 95eea91603e107052232145320945aca, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:25,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 22:02:25,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 95eea91603e107052232145320945aca 2023-09-27 22:02:25,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 95eea91603e107052232145320945aca, disabling compactions & flushes 2023-09-27 22:02:25,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:25,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:25,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. after waiting 0 ms 2023-09-27 22:02:25,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:25,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-27 22:02:25,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca. 2023-09-27 22:02:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 95eea91603e107052232145320945aca: 2023-09-27 22:02:25,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 95eea91603e107052232145320945aca 2023-09-27 22:02:25,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=95eea91603e107052232145320945aca, regionState=CLOSED 2023-09-27 22:02:25,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695852145418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852145418"}]},"ts":"1695852145418"} 2023-09-27 22:02:25,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-27 22:02:25,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 95eea91603e107052232145320945aca, server=jenkins-hbase4.apache.org,32927,1695852059054 in 167 msec 2023-09-27 22:02:25,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-27 22:02:25,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95eea91603e107052232145320945aca, UNASSIGN in 172 msec 2023-09-27 22:02:25,424 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852145423"}]},"ts":"1695852145423"} 2023-09-27 22:02:25,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-27 22:02:25,426 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-27 22:02:25,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-27 22:02:25,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 22:02:25,548 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-27 22:02:25,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,551 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,552 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,556 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca 2023-09-27 22:02:25,556 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:25,556 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:25,556 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,556 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,556 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,558 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,558 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 22:02:25,558 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 22:02:25,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 22:02:25,558 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:02:25,558 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/recovered.edits] 2023-09-27 22:02:25,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 22:02:25,558 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:02:25,558 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,558 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:02:25,558 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:02:25,559 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/recovered.edits] 2023-09-27 22:02:25,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:25,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:25,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 22:02:25,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:25,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:25,560 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/recovered.edits] 2023-09-27 22:02:25,564 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/016b8b4191c4469cbdc14a9a55db3f65.5ba7f357509bc612f942e2255639f8ae to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/016b8b4191c4469cbdc14a9a55db3f65.5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:25,564 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/cf/0c1fbb98a6a64f638b519b6b0072fb55 2023-09-27 22:02:25,564 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/cf/016b8b4191c4469cbdc14a9a55db3f65 2023-09-27 22:02:25,565 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/0c1fbb98a6a64f638b519b6b0072fb55.f9b07054cfa4e20ccfdddf62a6e5a519 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/cf/0c1fbb98a6a64f638b519b6b0072fb55.f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:25,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/recovered.edits/8.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519/recovered.edits/8.seqid 2023-09-27 22:02:25,568 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/recovered.edits/8.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae/recovered.edits/8.seqid 2023-09-27 22:02:25,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9b07054cfa4e20ccfdddf62a6e5a519 2023-09-27 22:02:25,568 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5ba7f357509bc612f942e2255639f8ae 2023-09-27 22:02:25,569 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/recovered.edits/12.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca/recovered.edits/12.seqid 2023-09-27 22:02:25,570 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95eea91603e107052232145320945aca 2023-09-27 22:02:25,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 22:02:25,571 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,573 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-27 22:02:25,575 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-27 22:02:25,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-27 22:02:25,576 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852145576"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:25,577 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-27 22:02:25,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 95eea91603e107052232145320945aca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695852131775.95eea91603e107052232145320945aca.', STARTKEY => '', ENDKEY => ''}] 2023-09-27 22:02:25,577 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-27 22:02:25,578 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852145577"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:25,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-27 22:02:25,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:25,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-09-27 22:02:25,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 22:02:25,661 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-27 22:02:25,661 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 22:02:25,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852145665"}]},"ts":"1695852145665"} 2023-09-27 22:02:25,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-27 22:02:25,668 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-27 22:02:25,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, UNASSIGN}] 2023-09-27 22:02:25,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, UNASSIGN 2023-09-27 22:02:25,670 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, UNASSIGN 2023-09-27 22:02:25,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=041a7d808715c1286072dcb4078e055c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:25,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c361d63d2f1d72aae9c6cd7eb7ba9894, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:25,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852145671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852145671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852145671"}]},"ts":"1695852145671"} 2023-09-27 22:02:25,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852145671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852145671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852145671"}]},"ts":"1695852145671"} 2023-09-27 22:02:25,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 041a7d808715c1286072dcb4078e055c, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:25,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure c361d63d2f1d72aae9c6cd7eb7ba9894, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:25,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 22:02:25,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:25,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c361d63d2f1d72aae9c6cd7eb7ba9894, disabling compactions & flushes 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 041a7d808715c1286072dcb4078e055c, disabling compactions & flushes 2023-09-27 22:02:25,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:25,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. after waiting 0 ms 2023-09-27 22:02:25,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:25,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. after waiting 0 ms 2023-09-27 22:02:25,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:25,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:25,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:25,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:25,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:25,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c. 2023-09-27 22:02:25,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894. 2023-09-27 22:02:25,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 041a7d808715c1286072dcb4078e055c: 2023-09-27 22:02:25,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c361d63d2f1d72aae9c6cd7eb7ba9894: 2023-09-27 22:02:25,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:25,839 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=041a7d808715c1286072dcb4078e055c, regionState=CLOSED 2023-09-27 22:02:25,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852145839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852145839"}]},"ts":"1695852145839"} 2023-09-27 22:02:25,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:25,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c361d63d2f1d72aae9c6cd7eb7ba9894, regionState=CLOSED 2023-09-27 22:02:25,840 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695852145840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852145840"}]},"ts":"1695852145840"} 2023-09-27 22:02:25,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-27 22:02:25,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 041a7d808715c1286072dcb4078e055c, server=jenkins-hbase4.apache.org,32927,1695852059054 in 169 msec 2023-09-27 22:02:25,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-27 22:02:25,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure c361d63d2f1d72aae9c6cd7eb7ba9894, server=jenkins-hbase4.apache.org,33753,1695852059101 in 169 msec 2023-09-27 22:02:25,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=041a7d808715c1286072dcb4078e055c, UNASSIGN in 174 msec 2023-09-27 22:02:25,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-27 22:02:25,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c361d63d2f1d72aae9c6cd7eb7ba9894, UNASSIGN in 175 msec 2023-09-27 22:02:25,845 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852145845"}]},"ts":"1695852145845"} 2023-09-27 22:02:25,846 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-27 22:02:25,849 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-27 22:02:25,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-27 22:02:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 22:02:25,967 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-27 22:02:25,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,970 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,971 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,972 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,974 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,975 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,975 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,974 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 22:02:25,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 22:02:25,975 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:25,975 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:25,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,976 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:25,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-27 22:02:25,977 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 22:02:25,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/recovered.edits] 2023-09-27 22:02:25,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 22:02:25,978 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/recovered.edits] 2023-09-27 22:02:25,981 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/cf/86cfc08b5cc349efb49fbbbb8c87b751 2023-09-27 22:02:25,981 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/cf/d221991ca3404824899a770ad14932eb 2023-09-27 22:02:25,984 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c/recovered.edits/9.seqid 2023-09-27 22:02:25,984 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894/recovered.edits/9.seqid 2023-09-27 22:02:25,985 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/041a7d808715c1286072dcb4078e055c 2023-09-27 22:02:25,985 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c361d63d2f1d72aae9c6cd7eb7ba9894 2023-09-27 22:02:25,985 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 22:02:25,985 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 22:02:25,986 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-27 22:02:25,988 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309275e335ebfef4a4ffd8ad50400820c7071 2023-09-27 22:02:25,989 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092783f47cf471db4774a5da12526b0dbf3c 2023-09-27 22:02:25,990 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 22:02:25,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,993 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-27 22:02:25,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-27 22:02:25,996 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:25,996 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-27 22:02:25,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852145996"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:25,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852145996"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:25,998 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:02:25,998 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c361d63d2f1d72aae9c6cd7eb7ba9894, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695852130619.c361d63d2f1d72aae9c6cd7eb7ba9894.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 041a7d808715c1286072dcb4078e055c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695852130619.041a7d808715c1286072dcb4078e055c.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:02:25,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-27 22:02:25,998 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852145998"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:25,999 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-27 22:02:26,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:26,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 34 msec 2023-09-27 22:02:26,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 22:02:26,079 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-27 22:02:26,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 22:02:26,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:26,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 22:02:26,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 22:02:26,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-27 22:02:26,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 22:02:26,119 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:38590 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:53748 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-294575578_1 at /127.0.0.1:53726 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-294575578_1 at /127.0.0.1:38562 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:43229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:39718 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3957 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 138), ProcessCount=168 (was 168), AvailableMemoryMB=4375 (was 4540) 2023-09-27 22:02:26,119 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-27 22:02:26,138 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=123, ProcessCount=168, AvailableMemoryMB=4374 2023-09-27 22:02:26,138 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-27 22:02:26,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:02:26,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:26,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:02:26,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-27 22:02:26,143 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:02:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 22:02:26,145 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,145 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,145 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 empty. 2023-09-27 22:02:26,145 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 empty. 2023-09-27 22:02:26,146 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,146 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,146 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 22:02:26,155 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 22:02:26,156 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c972f82e3db394dfe2220407811008e1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:26,156 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8912949b4b9ec5806fa399fc63c9c5c0, NAME => 'testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c972f82e3db394dfe2220407811008e1, disabling compactions & flushes 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8912949b4b9ec5806fa399fc63c9c5c0, disabling compactions & flushes 2023-09-27 22:02:26,163 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,163 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. after waiting 0 ms 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,163 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,163 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,164 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. after waiting 0 ms 2023-09-27 22:02:26,164 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,164 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c972f82e3db394dfe2220407811008e1: 2023-09-27 22:02:26,164 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,164 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8912949b4b9ec5806fa399fc63c9c5c0: 2023-09-27 22:02:26,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:02:26,166 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852146166"}]},"ts":"1695852146166"} 2023-09-27 22:02:26,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852146166"}]},"ts":"1695852146166"} 2023-09-27 22:02:26,168 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:02:26,169 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:02:26,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852146169"}]},"ts":"1695852146169"} 2023-09-27 22:02:26,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 22:02:26,173 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:02:26,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:02:26,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:02:26,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:02:26,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:02:26,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, ASSIGN}] 2023-09-27 22:02:26,176 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, ASSIGN 2023-09-27 22:02:26,177 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, ASSIGN 2023-09-27 22:02:26,177 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40159,1695852059137; forceNewPlan=false, retain=false 2023-09-27 22:02:26,177 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:02:26,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 22:02:26,328 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:02:26,330 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c972f82e3db394dfe2220407811008e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,330 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8912949b4b9ec5806fa399fc63c9c5c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146330"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852146330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852146330"}]},"ts":"1695852146330"} 2023-09-27 22:02:26,330 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146330"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852146330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852146330"}]},"ts":"1695852146330"} 2023-09-27 22:02:26,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 8912949b4b9ec5806fa399fc63c9c5c0, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:26,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c972f82e3db394dfe2220407811008e1, server=jenkins-hbase4.apache.org,40159,1695852059137}] 2023-09-27 22:02:26,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 22:02:26,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8912949b4b9ec5806fa399fc63c9c5c0, NAME => 'testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. service=AccessControlService 2023-09-27 22:02:26,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:26,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c972f82e3db394dfe2220407811008e1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:02:26,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. service=AccessControlService 2023-09-27 22:02:26,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:26,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:26,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,494 INFO [StoreOpener-8912949b4b9ec5806fa399fc63c9c5c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,495 INFO [StoreOpener-c972f82e3db394dfe2220407811008e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,495 DEBUG [StoreOpener-8912949b4b9ec5806fa399fc63c9c5c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf 2023-09-27 22:02:26,495 DEBUG [StoreOpener-8912949b4b9ec5806fa399fc63c9c5c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf 2023-09-27 22:02:26,495 INFO [StoreOpener-8912949b4b9ec5806fa399fc63c9c5c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8912949b4b9ec5806fa399fc63c9c5c0 columnFamilyName cf 2023-09-27 22:02:26,496 DEBUG [StoreOpener-c972f82e3db394dfe2220407811008e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf 2023-09-27 22:02:26,496 DEBUG [StoreOpener-c972f82e3db394dfe2220407811008e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf 2023-09-27 22:02:26,496 INFO [StoreOpener-c972f82e3db394dfe2220407811008e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c972f82e3db394dfe2220407811008e1 columnFamilyName cf 2023-09-27 22:02:26,497 INFO [StoreOpener-8912949b4b9ec5806fa399fc63c9c5c0-1] regionserver.HStore(310): Store=8912949b4b9ec5806fa399fc63c9c5c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:26,497 INFO [StoreOpener-c972f82e3db394dfe2220407811008e1-1] regionserver.HStore(310): Store=c972f82e3db394dfe2220407811008e1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:26,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:26,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:26,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:26,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c972f82e3db394dfe2220407811008e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66209405, jitterRate=-0.013402983546257019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c972f82e3db394dfe2220407811008e1: 2023-09-27 22:02:26,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1., pid=94, masterSystemTime=1695852146484 2023-09-27 22:02:26,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:26,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8912949b4b9ec5806fa399fc63c9c5c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58863863, jitterRate=-0.12286008894443512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:26,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8912949b4b9ec5806fa399fc63c9c5c0: 2023-09-27 22:02:26,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0., pid=93, masterSystemTime=1695852146483 2023-09-27 22:02:26,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,514 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c972f82e3db394dfe2220407811008e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,514 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852146514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852146514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852146514"}]},"ts":"1695852146514"} 2023-09-27 22:02:26,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8912949b4b9ec5806fa399fc63c9c5c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,514 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852146514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852146514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852146514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852146514"}]},"ts":"1695852146514"} 2023-09-27 22:02:26,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-27 22:02:26,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c972f82e3db394dfe2220407811008e1, server=jenkins-hbase4.apache.org,40159,1695852059137 in 183 msec 2023-09-27 22:02:26,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-27 22:02:26,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 8912949b4b9ec5806fa399fc63c9c5c0, server=jenkins-hbase4.apache.org,32927,1695852059054 in 184 msec 2023-09-27 22:02:26,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, ASSIGN in 343 msec 2023-09-27 22:02:26,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-27 22:02:26,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, ASSIGN in 343 msec 2023-09-27 22:02:26,519 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:02:26,519 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852146519"}]},"ts":"1695852146519"} 2023-09-27 22:02:26,520 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 22:02:26,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:02:26,522 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-27 22:02:26,524 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:02:26,526 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:26,526 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:26,526 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:26,526 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:26,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:26,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:26,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:26,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:26,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 387 msec 2023-09-27 22:02:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 22:02:26,746 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-27 22:02:26,748 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:26,748 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,750 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:26,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852146785 (current time:1695852146785). 2023-09-27 22:02:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:26,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x2c12f2fc to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:26,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69a90256, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:26,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:26,797 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:26,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c12f2fc to 127.0.0.1:51065 2023-09-27 22:02:26,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:26,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x7a67f6db to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:26,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41597e79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:26,806 DEBUG [hconnection-0x60c37fb6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:26,807 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:26,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a67f6db to 127.0.0.1:51065 2023-09-27 22:02:26,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:26,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:02:26,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:26,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:26,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:26,815 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:26,816 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695852746816 2023-09-27 22:02:26,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:26,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:26,817 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:26,817 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:26,818 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:26,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:26,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-27 22:02:26,822 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:26,822 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695852746822 2023-09-27 22:02:26,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,834 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-27 22:02:26,834 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:26,835 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 22:02:26,835 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 22:02:26,835 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,836 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,841 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,841 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,841 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,841 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,842 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,842 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,842 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,842 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,843 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:26,843 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:26,843 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:26,843 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:26,844 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:26,843 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:26,845 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:26,845 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:26,845 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:26,848 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,848 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,848 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,848 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:26,854 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,854 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cc13596[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:26,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 22:02:26,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cc13596[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:26,858 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 22:02:26,858 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:26,861 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:26,862 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:26,862 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:26,861 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,862 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,861 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,862 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. started... 2023-09-27 22:02:26,862 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. started... 2023-09-27 22:02:26,862 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:26,865 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8912949b4b9ec5806fa399fc63c9c5c0: 2023-09-27 22:02:26,865 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c972f82e3db394dfe2220407811008e1: 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:26,866 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:26,867 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:26,867 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:26,867 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:26,877 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. completed. 2023-09-27 22:02:26,877 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:26,877 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. completed. 2023-09-27 22:02:26,878 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:26,879 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,880 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:26,880 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40159,1695852059137': 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:26,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 22:02:26,887 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 22:02:26,887 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:26,887 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:26,887 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,887 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:26,889 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:26,890 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,890 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,892 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,892 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:26,892 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,897 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,896 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,896 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:26,897 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:26,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,898 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,917 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:26,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:02:26,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:02:26,918 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:02:26,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 22:02:26,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:26,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695852146816Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695852146907 (+91 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695852146907Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695852146907Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695852146910 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695852146920 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695852146926 (+6 ms) 2023-09-27 22:02:26,929 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:26,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 112 msec 2023-09-27 22:02:27,118 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:27,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:02:27,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:27,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:27,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40159] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:27,125 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:27,125 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:27,125 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:27,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:27,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852147134 (current time:1695852147134). 2023-09-27 22:02:27,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:27,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x06655dbc to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:27,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d20ac09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:27,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:27,144 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06655dbc to 127.0.0.1:51065 2023-09-27 22:02:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:27,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x1fe0184c to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:27,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33442eb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:27,152 DEBUG [hconnection-0x4b7c8c34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:27,154 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:27,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fe0184c to 127.0.0.1:51065 2023-09-27 22:02:27,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:27,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 22:02:27,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:27,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:27,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:27,161 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:27,161 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695852747161 2023-09-27 22:02:27,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:27,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 22:02:27,163 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:27,163 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:27,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:27,163 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 22:02:27,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-27 22:02:27,165 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:27,166 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695852747166 2023-09-27 22:02:27,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,177 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-27 22:02:27,177 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:27,177 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 22:02:27,178 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 22:02:27,178 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,178 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,179 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,179 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,179 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,180 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,180 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,180 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,180 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 22:02:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:27,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:27,183 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:27,183 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:27,183 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:27,184 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,184 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,184 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:27,185 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,185 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,185 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,186 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 22:02:27,186 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,189 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 22:02:27,189 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 22:02:27,189 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 22:02:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:27,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 22:02:27,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e575dac[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:27,196 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:27,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 22:02:27,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e575dac[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:27,198 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 22:02:27,198 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:27,209 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,209 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,209 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:27,209 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:27,209 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 22:02:27,210 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:27,210 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:27,209 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:27,209 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. started... 2023-09-27 22:02:27,210 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. started... 2023-09-27 22:02:27,210 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8912949b4b9ec5806fa399fc63c9c5c0 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-27 22:02:27,210 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c972f82e3db394dfe2220407811008e1 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-27 22:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:27,211 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:27,228 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c 2023-09-27 22:02:27,229 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9 2023-09-27 22:02:27,237 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/.tmp/cf/8260d9acfc1f4172aef9ed61a8ec857c 2023-09-27 22:02:27,238 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/.tmp/cf/9cc31f1a09a04779b11c75d3dc39f487 2023-09-27 22:02:27,242 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/.tmp/cf/8260d9acfc1f4172aef9ed61a8ec857c as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c 2023-09-27 22:02:27,243 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/.tmp/cf/9cc31f1a09a04779b11c75d3dc39f487 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487 2023-09-27 22:02:27,251 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c, entries=49, sequenceid=6, filesize=13.4 K 2023-09-27 22:02:27,251 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487, entries=1, sequenceid=6, filesize=5.1 K 2023-09-27 22:02:27,251 INFO [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for c972f82e3db394dfe2220407811008e1 in 41ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:27,251 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 22:02:27,251 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 8912949b4b9ec5806fa399fc63c9c5c0 in 41ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:27,252 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 22:02:27,254 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8912949b4b9ec5806fa399fc63c9c5c0: 2023-09-27 22:02:27,254 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c972f82e3db394dfe2220407811008e1: 2023-09-27 22:02:27,254 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,254 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487] hfiles 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c] hfiles 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,255 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:27,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:02:27,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:02:27,264 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. completed. 2023-09-27 22:02:27,264 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:02:27,264 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:27,265 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. completed. 2023-09-27 22:02:27,265 DEBUG [rs(jenkins-hbase4.apache.org,40159,1695852059137)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 22:02:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:27,267 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:27,269 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 22:02:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 22:02:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40159,1695852059137': 2023-09-27 22:02:27,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 22:02:27,276 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 22:02:27,276 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:27,276 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:27,276 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,276 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:27,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,281 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,281 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,281 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,283 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:27,283 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,283 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:27,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,286 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:27,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:27,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,286 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:27,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,288 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c] mob files 2023-09-27 22:02:27,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9 2023-09-27 22:02:27,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c 2023-09-27 22:02:27,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 22:02:27,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,315 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695852147162Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695852147295 (+133 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695852147295Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695852147295Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695852147299 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695852147308 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695852147315 (+7 ms) 2023-09-27 22:02:27,318 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 22:02:27,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 156 msec 2023-09-27 22:02:27,465 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:27,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 22:02:27,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:27,466 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466 2023-09-27 22:02:27,466 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36545, tgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466, rawTgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:27,487 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:27,487 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1060481707_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,487 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-27 22:02:27,493 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:27,514 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:27,514 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:27,514 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:27,515 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,380 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-5366614310213147597.jar 2023-09-27 22:02:28,380 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,380 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,446 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-3333929698405464789.jar 2023-09-27 22:02:28,447 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,447 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,447 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:02:28,449 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:02:28,449 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:02:28,450 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:02:28,450 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:02:28,450 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:02:28,451 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:02:28,451 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:02:28,451 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:02:28,452 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:02:28,452 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:28,453 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:28,453 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:28,453 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:28,453 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:28,454 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:28,454 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:28,801 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:02:28,803 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-27 22:02:29,704 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:29,704 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:29,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0005_000001 (auth:SIMPLE) 2023-09-27 22:02:30,376 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0006_000001 (auth:SIMPLE) 2023-09-27 22:02:31,011 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:02:34,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0006_000001 (auth:SIMPLE) 2023-09-27 22:02:37,147 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:02:37,148 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:02:37,152 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:37,152 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:02:37,153 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:02:37,153 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:37,153 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 22:02:37,153 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 22:02:37,154 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:37,154 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 22:02:37,154 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852147466/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 22:02:37,159 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 22:02:37,163 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852157163"}]},"ts":"1695852157163"} 2023-09-27 22:02:37,164 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 22:02:37,166 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-27 22:02:37,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, UNASSIGN}] 2023-09-27 22:02:37,171 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, UNASSIGN 2023-09-27 22:02:37,171 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, UNASSIGN 2023-09-27 22:02:37,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8912949b4b9ec5806fa399fc63c9c5c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:37,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c972f82e3db394dfe2220407811008e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:37,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852157171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852157171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852157171"}]},"ts":"1695852157171"} 2023-09-27 22:02:37,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852157171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852157171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852157171"}]},"ts":"1695852157171"} 2023-09-27 22:02:37,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8912949b4b9ec5806fa399fc63c9c5c0, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:37,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c972f82e3db394dfe2220407811008e1, server=jenkins-hbase4.apache.org,40159,1695852059137}] 2023-09-27 22:02:37,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 22:02:37,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:37,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8912949b4b9ec5806fa399fc63c9c5c0, disabling compactions & flushes 2023-09-27 22:02:37,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:37,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:37,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. after waiting 0 ms 2023-09-27 22:02:37,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:37,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:37,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c972f82e3db394dfe2220407811008e1, disabling compactions & flushes 2023-09-27 22:02:37,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:37,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:37,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. after waiting 0 ms 2023-09-27 22:02:37,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:37,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:37,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:37,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:37,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:37,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1. 2023-09-27 22:02:37,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0. 2023-09-27 22:02:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c972f82e3db394dfe2220407811008e1: 2023-09-27 22:02:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8912949b4b9ec5806fa399fc63c9c5c0: 2023-09-27 22:02:37,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:37,340 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c972f82e3db394dfe2220407811008e1, regionState=CLOSED 2023-09-27 22:02:37,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:37,340 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852157340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852157340"}]},"ts":"1695852157340"} 2023-09-27 22:02:37,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8912949b4b9ec5806fa399fc63c9c5c0, regionState=CLOSED 2023-09-27 22:02:37,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695852157340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852157340"}]},"ts":"1695852157340"} 2023-09-27 22:02:37,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-27 22:02:37,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c972f82e3db394dfe2220407811008e1, server=jenkins-hbase4.apache.org,40159,1695852059137 in 168 msec 2023-09-27 22:02:37,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-27 22:02:37,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8912949b4b9ec5806fa399fc63c9c5c0, server=jenkins-hbase4.apache.org,32927,1695852059054 in 169 msec 2023-09-27 22:02:37,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c972f82e3db394dfe2220407811008e1, UNASSIGN in 176 msec 2023-09-27 22:02:37,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-27 22:02:37,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8912949b4b9ec5806fa399fc63c9c5c0, UNASSIGN in 177 msec 2023-09-27 22:02:37,346 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852157346"}]},"ts":"1695852157346"} 2023-09-27 22:02:37,349 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 22:02:37,351 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-27 22:02:37,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 193 msec 2023-09-27 22:02:37,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 22:02:37,465 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-27 22:02:37,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,471 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,474 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,474 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,474 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,474 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,474 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:37,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 22:02:37,474 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:37,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 22:02:37,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 22:02:37,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 22:02:37,476 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/recovered.edits] 2023-09-27 22:02:37,476 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/recovered.edits] 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,477 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:37,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 22:02:37,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/cf/8260d9acfc1f4172aef9ed61a8ec857c 2023-09-27 22:02:37,482 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/cf/9cc31f1a09a04779b11c75d3dc39f487 2023-09-27 22:02:37,485 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0/recovered.edits/9.seqid 2023-09-27 22:02:37,486 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1/recovered.edits/9.seqid 2023-09-27 22:02:37,486 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8912949b4b9ec5806fa399fc63c9c5c0 2023-09-27 22:02:37,486 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testEmptyExportFileSystemState/c972f82e3db394dfe2220407811008e1 2023-09-27 22:02:37,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 22:02:37,487 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 22:02:37,488 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-27 22:02:37,491 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230927554f3e59ef154d7abd0af6401e6226c9 2023-09-27 22:02:37,492 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309276051c03cce69456593529b7857849a2c 2023-09-27 22:02:37,493 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 22:02:37,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,496 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-27 22:02:37,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-27 22:02:37,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-27 22:02:37,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852157499"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:37,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852157499"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:37,501 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:02:37,501 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8912949b4b9ec5806fa399fc63c9c5c0, NAME => 'testtb-testEmptyExportFileSystemState,,1695852146139.8912949b4b9ec5806fa399fc63c9c5c0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c972f82e3db394dfe2220407811008e1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695852146139.c972f82e3db394dfe2220407811008e1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:02:37,501 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-27 22:02:37,501 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852157501"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:37,503 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-27 22:02:37,504 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 22:02:37,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-27 22:02:37,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 22:02:37,580 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-27 22:02:37,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-27 22:02:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:37,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-27 22:02:37,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-27 22:02:37,619 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:43807 from appattempt_1695852065461_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:50130 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:46467 from appattempt_1695852065461_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:45496 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1656800326_17 at /127.0.0.1:34488 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1798604698_1 at /127.0.0.1:46302 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1798604698_1 at /127.0.0.1:49376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cf42e7-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:32879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=104 (was 123), ProcessCount=168 (was 168), AvailableMemoryMB=4352 (was 4374) 2023-09-27 22:02:37,619 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-27 22:02:37,640 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=104, ProcessCount=168, AvailableMemoryMB=4352 2023-09-27 22:02:37,641 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-27 22:02:37,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 22:02:37,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:37,645 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 22:02:37,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-27 22:02:37,646 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 22:02:37,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 22:02:37,648 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:37,648 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:37,648 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e empty. 2023-09-27 22:02:37,648 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e empty. 2023-09-27 22:02:37,649 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:37,649 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:37,649 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 22:02:37,658 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-27 22:02:37,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88991a29dadb8afab039ced3c72f927e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:37,660 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 84f3de701904f8374972db849bd1578e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp 2023-09-27 22:02:37,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:37,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 84f3de701904f8374972db849bd1578e, disabling compactions & flushes 2023-09-27 22:02:37,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:37,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. after waiting 0 ms 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:37,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 84f3de701904f8374972db849bd1578e: 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 88991a29dadb8afab039ced3c72f927e, disabling compactions & flushes 2023-09-27 22:02:37,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. after waiting 0 ms 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:37,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:37,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 88991a29dadb8afab039ced3c72f927e: 2023-09-27 22:02:37,683 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 22:02:37,684 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852157684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852157684"}]},"ts":"1695852157684"} 2023-09-27 22:02:37,684 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852157684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852157684"}]},"ts":"1695852157684"} 2023-09-27 22:02:37,686 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 22:02:37,687 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 22:02:37,687 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852157687"}]},"ts":"1695852157687"} 2023-09-27 22:02:37,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-27 22:02:37,692 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 22:02:37,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 22:02:37,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 22:02:37,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 22:02:37,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 22:02:37,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, ASSIGN}] 2023-09-27 22:02:37,696 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, ASSIGN 2023-09-27 22:02:37,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, ASSIGN 2023-09-27 22:02:37,697 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32927,1695852059054; forceNewPlan=false, retain=false 2023-09-27 22:02:37,697 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33753,1695852059101; forceNewPlan=false, retain=false 2023-09-27 22:02:37,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 22:02:37,847 INFO [jenkins-hbase4:45673] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 22:02:37,850 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=88991a29dadb8afab039ced3c72f927e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:37,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=84f3de701904f8374972db849bd1578e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:37,850 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852157850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852157850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852157850"}]},"ts":"1695852157850"} 2023-09-27 22:02:37,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852157850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852157850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852157850"}]},"ts":"1695852157850"} 2023-09-27 22:02:37,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 88991a29dadb8afab039ced3c72f927e, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:37,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 84f3de701904f8374972db849bd1578e, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:37,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 22:02:38,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88991a29dadb8afab039ced3c72f927e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 22:02:38,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 84f3de701904f8374972db849bd1578e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 22:02:38,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. service=AccessControlService 2023-09-27 22:02:38,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. service=AccessControlService 2023-09-27 22:02:38,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:38,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,009 INFO [StoreOpener-84f3de701904f8374972db849bd1578e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,009 INFO [StoreOpener-88991a29dadb8afab039ced3c72f927e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,010 DEBUG [StoreOpener-84f3de701904f8374972db849bd1578e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf 2023-09-27 22:02:38,010 DEBUG [StoreOpener-88991a29dadb8afab039ced3c72f927e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf 2023-09-27 22:02:38,010 DEBUG [StoreOpener-88991a29dadb8afab039ced3c72f927e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf 2023-09-27 22:02:38,010 DEBUG [StoreOpener-84f3de701904f8374972db849bd1578e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf 2023-09-27 22:02:38,011 INFO [StoreOpener-88991a29dadb8afab039ced3c72f927e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88991a29dadb8afab039ced3c72f927e columnFamilyName cf 2023-09-27 22:02:38,011 INFO [StoreOpener-84f3de701904f8374972db849bd1578e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84f3de701904f8374972db849bd1578e columnFamilyName cf 2023-09-27 22:02:38,012 INFO [StoreOpener-84f3de701904f8374972db849bd1578e-1] regionserver.HStore(310): Store=84f3de701904f8374972db849bd1578e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:38,012 INFO [StoreOpener-88991a29dadb8afab039ced3c72f927e-1] regionserver.HStore(310): Store=88991a29dadb8afab039ced3c72f927e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 22:02:38,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:38,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:38,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:38,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 22:02:38,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88991a29dadb8afab039ced3c72f927e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65537525, jitterRate=-0.023414775729179382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:38,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 84f3de701904f8374972db849bd1578e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73877490, jitterRate=0.10086038708686829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 22:02:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88991a29dadb8afab039ced3c72f927e: 2023-09-27 22:02:38,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 84f3de701904f8374972db849bd1578e: 2023-09-27 22:02:38,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e., pid=109, masterSystemTime=1695852158004 2023-09-27 22:02:38,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e., pid=108, masterSystemTime=1695852158003 2023-09-27 22:02:38,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=84f3de701904f8374972db849bd1578e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,021 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852158020"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852158020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852158020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852158020"}]},"ts":"1695852158020"} 2023-09-27 22:02:38,021 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=88991a29dadb8afab039ced3c72f927e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,021 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852158021"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695852158021"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695852158021"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695852158021"}]},"ts":"1695852158021"} 2023-09-27 22:02:38,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-27 22:02:38,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-27 22:02:38,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 84f3de701904f8374972db849bd1578e, server=jenkins-hbase4.apache.org,32927,1695852059054 in 170 msec 2023-09-27 22:02:38,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 88991a29dadb8afab039ced3c72f927e, server=jenkins-hbase4.apache.org,33753,1695852059101 in 171 msec 2023-09-27 22:02:38,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, ASSIGN in 331 msec 2023-09-27 22:02:38,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-27 22:02:38,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, ASSIGN in 331 msec 2023-09-27 22:02:38,027 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 22:02:38,027 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852158027"}]},"ts":"1695852158027"} 2023-09-27 22:02:38,028 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-27 22:02:38,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 22:02:38,033 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-27 22:02:38,035 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 22:02:38,036 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:38,036 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:38,036 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:38,036 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:38,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:38,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:38,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:38,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 22:02:38,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 395 msec 2023-09-27 22:02:38,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 22:02:38,250 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-27 22:02:38,252 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,252 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,254 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:38,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852158263 (current time:1695852158263). 2023-09-27 22:02:38,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:38,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x33e8f685 to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:38,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:38,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:38,271 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33e8f685 to 127.0.0.1:51065 2023-09-27 22:02:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:38,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x43004aac to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:38,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3728c097, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:38,278 DEBUG [hconnection-0x10d16b50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:38,280 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43004aac to 127.0.0.1:51065 2023-09-27 22:02:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 22:02:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:38,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,287 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,288 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695852758288 2023-09-27 22:02:38,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,289 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:38,289 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:38,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,290 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-27 22:02:38,292 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,292 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695852758292 2023-09-27 22:02:38,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,307 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 22:02:38,308 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,309 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 22:02:38,309 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 22:02:38,309 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,309 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,310 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,310 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,310 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,311 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,311 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,311 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,311 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,312 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,317 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,324 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,325 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,325 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,325 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,325 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,325 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,325 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,325 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,326 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,326 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,326 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d21ac6d[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 22:02:38,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d21ac6d[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:38,329 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 22:02:38,329 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,331 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:38,331 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:38,331 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:38,331 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,331 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:38,331 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,331 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. started... 2023-09-27 22:02:38,331 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. started... 2023-09-27 22:02:38,332 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 84f3de701904f8374972db849bd1578e: 2023-09-27 22:02:38,332 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88991a29dadb8afab039ced3c72f927e: 2023-09-27 22:02:38,332 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,333 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,333 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,333 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,333 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:38,333 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:38,334 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:38,333 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,334 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 22:02:38,344 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. completed. 2023-09-27 22:02:38,344 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,344 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. completed. 2023-09-27 22:02:38,344 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,344 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:38,346 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,346 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,346 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,347 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,348 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:02:38,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 22:02:38,356 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 22:02:38,356 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:38,356 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:38,356 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,356 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:38,358 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,358 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,358 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,358 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,358 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,359 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,359 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,360 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,360 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,362 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,363 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,363 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,366 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,366 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,367 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:38,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,368 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,368 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,369 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,369 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 22:02:38,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,389 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 22:02:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:02:38,390 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:02:38,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 22:02:38,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,398 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695852158288Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695852158382 (+94 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695852158382Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695852158382Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695852158386 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695852158392 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695852158397 (+5 ms) 2023-09-27 22:02:38,401 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 112 msec 2023-09-27 22:02:38,590 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:38,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 22:02:38,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:38,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33753] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32927] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 22:02:38,597 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,597 DEBUG [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,597 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 22:02:38,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695852158606 (current time:1695852158606). 2023-09-27 22:02:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 22:02:38,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x7833d31a to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:38,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6323aca7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:38,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:38,619 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:38,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7833d31a to 127.0.0.1:51065 2023-09-27 22:02:38,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:38,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(139): Connect 0x01e1a1fc to 127.0.0.1:51065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 22:02:38,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@672c19d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 22:02:38,626 DEBUG [hconnection-0x1914d70f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 22:02:38,627 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 22:02:38,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e1a1fc to 127.0.0.1:51065 2023-09-27 22:02:38,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:02:38,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 22:02:38,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 22:02:38,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,635 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,635 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695852758635 2023-09-27 22:02:38,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 22:02:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 22:02:38,637 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 22:02:38,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 22:02:38,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-27 22:02:38,639 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,640 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695852758640 2023-09-27 22:02:38,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,652 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 22:02:38,652 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,653 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 22:02:38,653 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 22:02:38,654 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,654 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,656 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,656 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,657 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,657 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,657 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 22:02:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 22:02:38,658 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,658 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,658 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 22:02:38,660 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,661 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 22:02:38,661 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,661 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 22:02:38,661 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,661 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40159,1695852059137' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 22:02:38,662 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,662 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,662 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,662 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,663 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 22:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32927,1695852059054' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27c3e5c2[Count = 1] remaining members to acquire global barrier 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33753,1695852059101' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 22:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27c3e5c2[Count = 0] remaining members to acquire global barrier 2023-09-27 22:02:38,667 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 22:02:38,667 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,674 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,674 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40159,1695852059137' in zk 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:38,674 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,674 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,674 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 22:02:38,674 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. started... 2023-09-27 22:02:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 22:02:38,675 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 22:02:38,674 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. started... 2023-09-27 22:02:38,675 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 84f3de701904f8374972db849bd1578e 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 22:02:38,675 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88991a29dadb8afab039ced3c72f927e 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 22:02:38,676 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,676 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,676 DEBUG [member: 'jenkins-hbase4.apache.org,40159,1695852059137' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,690 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b 2023-09-27 22:02:38,691 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc 2023-09-27 22:02:38,697 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/.tmp/cf/9f91f5f7c8964b3088837ab7ba9b2477 2023-09-27 22:02:38,698 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/.tmp/cf/b4bde7cbbea34393801e52f80d2a6e0e 2023-09-27 22:02:38,702 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/.tmp/cf/b4bde7cbbea34393801e52f80d2a6e0e as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e 2023-09-27 22:02:38,702 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/.tmp/cf/9f91f5f7c8964b3088837ab7ba9b2477 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477 2023-09-27 22:02:38,706 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e, entries=48, sequenceid=6, filesize=13.5 K 2023-09-27 22:02:38,706 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477, entries=2, sequenceid=6, filesize=5.2 K 2023-09-27 22:02:38,707 INFO [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 84f3de701904f8374972db849bd1578e in 32ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:38,707 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 22:02:38,707 INFO [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 88991a29dadb8afab039ced3c72f927e in 32ms, sequenceid=6, compaction requested=false 2023-09-27 22:02:38,707 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 84f3de701904f8374972db849bd1578e: 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88991a29dadb8afab039ced3c72f927e: 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e] hfiles 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477] hfiles 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,710 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,717 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. completed. 2023-09-27 22:02:38,717 DEBUG [rs(jenkins-hbase4.apache.org,33753,1695852059101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:38,717 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. completed. 2023-09-27 22:02:38,717 DEBUG [rs(jenkins-hbase4.apache.org,32927,1695852059054)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32927,1695852059054' in zk 2023-09-27 22:02:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33753,1695852059101' in zk 2023-09-27 22:02:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 22:02:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,719 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,32927,1695852059054' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,720 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,720 DEBUG [member: 'jenkins-hbase4.apache.org,33753,1695852059101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 22:02:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32927,1695852059054': 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32927,1695852059054' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33753,1695852059101': 2023-09-27 22:02:38,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33753,1695852059101' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 22:02:38,728 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 22:02:38,728 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 22:02:38,728 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 22:02:38,728 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,728 INFO [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 22:02:38,730 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,729 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 22:02:38,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,730 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,731 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 22:02:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,732 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 22:02:38,732 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,733 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,737 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,737 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,737 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,738 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,737 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 22:02:38,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,738 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,738 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,737 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:38,737 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,738 DEBUG [(jenkins-hbase4.apache.org,45673,1695852057804)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 22:02:38,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 22:02:38,738 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 22:02:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 22:02:38,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,738 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,739 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 22:02:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 22:02:38,739 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:02:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,740 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 22:02:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 22:02:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 22:02:38,740 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:38,740 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:38,740 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,740 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,740 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 22:02:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b] mob files 2023-09-27 22:02:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc 2023-09-27 22:02:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b 2023-09-27 22:02:38,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 22:02:38,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,762 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695852158635Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695852158746 (+111 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695852158746Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695852158746Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695852158749 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695852158756 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695852158762 (+6 ms) 2023-09-27 22:02:38,765 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 22:02:38,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 129 msec 2023-09-27 22:02:38,940 DEBUG [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 22:02:38,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 22:02:38,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 22:02:38,941 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941 2023-09-27 22:02:38,941 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36545, tgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941, rawTgtDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941, srcFsUri=hdfs://localhost:36545, srcDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:38,963 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6 2023-09-27 22:02:38,963 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_580351234_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:38,963 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36545, inputRoot=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6, snapshotDir=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-27 22:02:38,971 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:39,387 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:39,387 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:39,387 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:39,388 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,256 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-1848427025373153299.jar 2023-09-27 22:02:40,256 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,256 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,322 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/hadoop-4516805383467653119.jar 2023-09-27 22:02:40,323 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,323 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,323 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,324 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,324 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,324 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 22:02:40,325 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 22:02:40,325 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 22:02:40,326 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 22:02:40,326 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 22:02:40,326 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 22:02:40,327 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 22:02:40,327 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 22:02:40,327 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 22:02:40,328 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 22:02:40,328 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 22:02:40,329 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:40,329 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:40,330 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:40,330 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:40,330 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 22:02:40,331 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:40,331 DEBUG [Listener at jenkins-hbase4.apache.org/37371] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 22:02:40,662 WARN [Listener at jenkins-hbase4.apache.org/37371] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 22:02:40,664 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-27 22:02:40,666 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-27 22:02:41,315 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:41,315 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 22:02:41,317 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0006_000001 (auth:SIMPLE) 2023-09-27 22:02:41,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0007_000001 (auth:SIMPLE) 2023-09-27 22:02:42,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:02:45,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0007_000001 (auth:SIMPLE) 2023-09-27 22:02:47,624 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0007_000001 (auth:SIMPLE) 2023-09-27 22:02:50,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695852065461_0007_000001 (auth:SIMPLE) 2023-09-27 22:02:51,815 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 22:02:51,816 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 22:02:51,826 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,826 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 22:02:51,826 INFO [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 22:02:51,826 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 22:02:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 22:02:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656800326_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 22:02:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37371] snapshot.TestExportSnapshot(367): hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/export-test/export-1695852158941/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 22:02:51,833 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:51,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 22:02:51,837 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852171837"}]},"ts":"1695852171837"} 2023-09-27 22:02:51,838 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-27 22:02:51,839 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-27 22:02:51,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, UNASSIGN}] 2023-09-27 22:02:51,841 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, UNASSIGN 2023-09-27 22:02:51,841 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, UNASSIGN 2023-09-27 22:02:51,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=88991a29dadb8afab039ced3c72f927e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:02:51,842 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=84f3de701904f8374972db849bd1578e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:02:51,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852171842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852171842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852171842"}]},"ts":"1695852171842"} 2023-09-27 22:02:51,842 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852171842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695852171842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695852171842"}]},"ts":"1695852171842"} 2023-09-27 22:02:51,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 88991a29dadb8afab039ced3c72f927e, server=jenkins-hbase4.apache.org,33753,1695852059101}] 2023-09-27 22:02:51,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 84f3de701904f8374972db849bd1578e, server=jenkins-hbase4.apache.org,32927,1695852059054}] 2023-09-27 22:02:51,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 22:02:51,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:51,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88991a29dadb8afab039ced3c72f927e, disabling compactions & flushes 2023-09-27 22:02:51,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:51,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:51,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. after waiting 0 ms 2023-09-27 22:02:51,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:51,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:51,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 84f3de701904f8374972db849bd1578e, disabling compactions & flushes 2023-09-27 22:02:51,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:51,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:51,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. after waiting 0 ms 2023-09-27 22:02:51,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:52,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:52,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:52,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:02:52,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e. 2023-09-27 22:02:52,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88991a29dadb8afab039ced3c72f927e: 2023-09-27 22:02:52,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:02:52,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e. 2023-09-27 22:02:52,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 84f3de701904f8374972db849bd1578e: 2023-09-27 22:02:52,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:52,010 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=88991a29dadb8afab039ced3c72f927e, regionState=CLOSED 2023-09-27 22:02:52,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 84f3de701904f8374972db849bd1578e 2023-09-27 22:02:52,011 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852172010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852172010"}]},"ts":"1695852172010"} 2023-09-27 22:02:52,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=84f3de701904f8374972db849bd1578e, regionState=CLOSED 2023-09-27 22:02:52,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695852172011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695852172011"}]},"ts":"1695852172011"} 2023-09-27 22:02:52,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-27 22:02:52,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 88991a29dadb8afab039ced3c72f927e, server=jenkins-hbase4.apache.org,33753,1695852059101 in 169 msec 2023-09-27 22:02:52,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-27 22:02:52,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 84f3de701904f8374972db849bd1578e, server=jenkins-hbase4.apache.org,32927,1695852059054 in 168 msec 2023-09-27 22:02:52,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88991a29dadb8afab039ced3c72f927e, UNASSIGN in 176 msec 2023-09-27 22:02:52,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-27 22:02:52,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=84f3de701904f8374972db849bd1578e, UNASSIGN in 177 msec 2023-09-27 22:02:52,018 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695852172018"}]},"ts":"1695852172018"} 2023-09-27 22:02:52,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-27 22:02:52,021 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-27 22:02:52,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-27 22:02:52,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 22:02:52,138 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-27 22:02:52,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,141 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,142 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,143 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:52,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:52,147 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,147 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,147 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,147 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/recovered.edits] 2023-09-27 22:02:52,148 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf, FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/recovered.edits] 2023-09-27 22:02:52,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 22:02:52,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 22:02:52,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 22:02:52,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:52,149 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 22:02:52,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 22:02:52,152 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477 to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/cf/9f91f5f7c8964b3088837ab7ba9b2477 2023-09-27 22:02:52,152 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/cf/b4bde7cbbea34393801e52f80d2a6e0e 2023-09-27 22:02:52,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e/recovered.edits/9.seqid 2023-09-27 22:02:52,155 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/recovered.edits/9.seqid to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e/recovered.edits/9.seqid 2023-09-27 22:02:52,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88991a29dadb8afab039ced3c72f927e 2023-09-27 22:02:52,155 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/84f3de701904f8374972db849bd1578e 2023-09-27 22:02:52,155 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 22:02:52,156 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 22:02:52,156 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-27 22:02:52,160 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927acb1aba9a60f41849cf107b65f431ecc 2023-09-27 22:02:52,161 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b to hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309277ccc9c67c73d4ea7af33d7b5933ca41b 2023-09-27 22:02:52,161 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 22:02:52,163 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,165 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-27 22:02:52,166 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-27 22:02:52,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-27 22:02:52,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852172167"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:52,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695852172167"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:52,169 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 22:02:52,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 88991a29dadb8afab039ced3c72f927e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695852157642.88991a29dadb8afab039ced3c72f927e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 84f3de701904f8374972db849bd1578e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695852157642.84f3de701904f8374972db849bd1578e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 22:02:52,169 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-27 22:02:52,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695852172169"}]},"ts":"9223372036854775807"} 2023-09-27 22:02:52,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-27 22:02:52,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-09-27 22:02:52,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 22:02:52,251 INFO [Listener at jenkins-hbase4.apache.org/37371] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-27 22:02:52,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 22:02:52,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 22:02:52,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45673] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 22:02:52,284 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=917 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=117 (was 104) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4271 (was 4352) 2023-09-27 22:02:52,284 WARN [Listener at jenkins-hbase4.apache.org/37371] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-27 22:02:52,285 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-27 22:02:52,295 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 22:02:52,406 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695852065461_0007_01_000001 is : 143 2023-09-27 22:02:57,575 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 22:03:06,420 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 22:03:20,536 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 22:03:20,537 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 22:03:20,645 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-27 22:03:20,652 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-27 22:03:20,653 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 22:03:20,663 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 22:03:20,766 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 22:03:20,766 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-27 22:03:20,766 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-27 22:03:20,766 INFO [Listener at jenkins-hbase4.apache.org/37371] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6315ad62 to 127.0.0.1:51065 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] util.JVMClusterUtil(257): Found active master hash=1753245453, stopped=false 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,767 DEBUG [Listener at jenkins-hbase4.apache.org/37371] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 22:03:20,767 INFO [Listener at jenkins-hbase4.apache.org/37371] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:03:20,769 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 22:03:20,769 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 22:03:20,769 INFO [Listener at jenkins-hbase4.apache.org/37371] procedure2.ProcedureExecutor(628): Stopping 2023-09-27 22:03:20,769 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 22:03:20,769 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 22:03:20,769 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:03:20,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:03:20,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:03:20,769 DEBUG [Listener at jenkins-hbase4.apache.org/37371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62e10562 to 127.0.0.1:51065 2023-09-27 22:03:20,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:03:20,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 22:03:20,770 DEBUG [Listener at jenkins-hbase4.apache.org/37371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,770 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32927,1695852059054' ***** 2023-09-27 22:03:20,770 DEBUG [Listener at jenkins-hbase4.apache.org/37371] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,770 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 22:03:20,770 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33753,1695852059101' ***** 2023-09-27 22:03:20,770 DEBUG [Listener at jenkins-hbase4.apache.org/37371] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,770 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 22:03:20,770 INFO [RS:0;jenkins-hbase4:32927] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 22:03:20,771 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40159,1695852059137' ***** 2023-09-27 22:03:20,771 INFO [RS:1;jenkins-hbase4:33753] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 22:03:20,771 INFO [RS:0;jenkins-hbase4:32927] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 22:03:20,771 DEBUG [Listener at jenkins-hbase4.apache.org/37371] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,771 INFO [RS:0;jenkins-hbase4:32927] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 22:03:20,771 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 22:03:20,771 INFO [RS:1;jenkins-hbase4:33753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 22:03:20,771 INFO [Listener at jenkins-hbase4.apache.org/37371] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 22:03:20,771 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 22:03:20,771 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(3305): Received CLOSE for 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:03:20,771 INFO [RS:1;jenkins-hbase4:33753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 22:03:20,771 INFO [RS:2;jenkins-hbase4:40159] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 22:03:20,771 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:03:20,771 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 22:03:20,771 DEBUG [RS:1;jenkins-hbase4:33753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x747d6ee4 to 127.0.0.1:51065 2023-09-27 22:03:20,772 DEBUG [RS:1;jenkins-hbase4:33753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,771 INFO [RS:2;jenkins-hbase4:40159] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 22:03:20,772 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:03:20,773 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33753,1695852059101; all regions closed. 2023-09-27 22:03:20,773 INFO [RS:2;jenkins-hbase4:40159] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 22:03:20,773 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:20,773 DEBUG [RS:0;jenkins-hbase4:32927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3954eb73 to 127.0.0.1:51065 2023-09-27 22:03:20,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 163c8ad227763306b9c34de6ea2ef93e, disabling compactions & flushes 2023-09-27 22:03:20,774 DEBUG [RS:0;jenkins-hbase4:32927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,774 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(3305): Received CLOSE for 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:03:20,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:03:20,776 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:03:20,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:03:20,776 DEBUG [RS:2;jenkins-hbase4:40159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cbc7047 to 127.0.0.1:51065 2023-09-27 22:03:20,776 INFO [RS:0;jenkins-hbase4:32927] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 22:03:20,776 DEBUG [RS:2;jenkins-hbase4:40159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b16fe5af51ffff75fb343bf8a08da16, disabling compactions & flushes 2023-09-27 22:03:20,777 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 22:03:20,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. after waiting 0 ms 2023-09-27 22:03:20,777 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1478): Online Regions={7b16fe5af51ffff75fb343bf8a08da16=hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16.} 2023-09-27 22:03:20,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:03:20,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:03:20,776 INFO [RS:0;jenkins-hbase4:32927] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 22:03:20,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. after waiting 0 ms 2023-09-27 22:03:20,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:03:20,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:03:20,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7b16fe5af51ffff75fb343bf8a08da16 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-27 22:03:20,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 163c8ad227763306b9c34de6ea2ef93e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-27 22:03:20,777 INFO [RS:0;jenkins-hbase4:32927] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 22:03:20,777 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-27 22:03:20,778 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-27 22:03:20,778 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1478): Online Regions={163c8ad227763306b9c34de6ea2ef93e=hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e., 1588230740=hbase:meta,,1.1588230740} 2023-09-27 22:03:20,778 DEBUG [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1504): Waiting on 7b16fe5af51ffff75fb343bf8a08da16 2023-09-27 22:03:20,778 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1504): Waiting on 1588230740, 163c8ad227763306b9c34de6ea2ef93e 2023-09-27 22:03:20,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 22:03:20,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 22:03:20,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 22:03:20,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 22:03:20,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 22:03:20,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-27 22:03:20,791 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:20,791 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:20,794 DEBUG [RS:1;jenkins-hbase4:33753] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs 2023-09-27 22:03:20,794 INFO [RS:1;jenkins-hbase4:33753] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33753%2C1695852059101:(num 1695852060770) 2023-09-27 22:03:20,794 DEBUG [RS:1;jenkins-hbase4:33753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,794 INFO [RS:1;jenkins-hbase4:33753] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:20,799 INFO [RS:1;jenkins-hbase4:33753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 22:03:20,802 INFO [RS:1;jenkins-hbase4:33753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 22:03:20,802 INFO [RS:1;jenkins-hbase4:33753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 22:03:20,802 INFO [RS:1;jenkins-hbase4:33753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 22:03:20,802 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 22:03:20,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/.tmp/info/cd88f473000d4363af829486ec0f8d84 2023-09-27 22:03:20,808 INFO [RS:1;jenkins-hbase4:33753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33753 2023-09-27 22:03:20,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/info/05dc0d059b2c45b8861a08123f7f4aa7 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33753,1695852059101 2023-09-27 22:03:20,816 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:20,817 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33753,1695852059101] 2023-09-27 22:03:20,817 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33753,1695852059101; numProcessing=1 2023-09-27 22:03:20,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/.tmp/l/df1c0b36aa26423daf545d5201b5f0c2 2023-09-27 22:03:20,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/.tmp/info/cd88f473000d4363af829486ec0f8d84 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/info/cd88f473000d4363af829486ec0f8d84 2023-09-27 22:03:20,820 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33753,1695852059101 already deleted, retry=false 2023-09-27 22:03:20,820 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33753,1695852059101 expired; onlineServers=2 2023-09-27 22:03:20,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05dc0d059b2c45b8861a08123f7f4aa7 2023-09-27 22:03:20,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df1c0b36aa26423daf545d5201b5f0c2 2023-09-27 22:03:20,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/.tmp/l/df1c0b36aa26423daf545d5201b5f0c2 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/l/df1c0b36aa26423daf545d5201b5f0c2 2023-09-27 22:03:20,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/info/cd88f473000d4363af829486ec0f8d84, entries=2, sequenceid=6, filesize=4.8 K 2023-09-27 22:03:20,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7b16fe5af51ffff75fb343bf8a08da16 in 50ms, sequenceid=6, compaction requested=false 2023-09-27 22:03:20,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df1c0b36aa26423daf545d5201b5f0c2 2023-09-27 22:03:20,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/l/df1c0b36aa26423daf545d5201b5f0c2, entries=7, sequenceid=18, filesize=5.2 K 2023-09-27 22:03:20,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 163c8ad227763306b9c34de6ea2ef93e in 59ms, sequenceid=18, compaction requested=false 2023-09-27 22:03:20,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/namespace/7b16fe5af51ffff75fb343bf8a08da16/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 22:03:20,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:03:20,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b16fe5af51ffff75fb343bf8a08da16: 2023-09-27 22:03:20,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695852061193.7b16fe5af51ffff75fb343bf8a08da16. 2023-09-27 22:03:20,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/acl/163c8ad227763306b9c34de6ea2ef93e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-27 22:03:20,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:20,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:03:20,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 163c8ad227763306b9c34de6ea2ef93e: 2023-09-27 22:03:20,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695852061926.163c8ad227763306b9c34de6ea2ef93e. 2023-09-27 22:03:20,918 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:20,918 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:33753-0x100ef6808bf0002, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:20,918 INFO [RS:1;jenkins-hbase4:33753] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33753,1695852059101; zookeeper connection closed. 2023-09-27 22:03:20,918 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1269edd6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1269edd6 2023-09-27 22:03:20,978 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40159,1695852059137; all regions closed. 2023-09-27 22:03:20,978 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 22:03:20,983 DEBUG [RS:2;jenkins-hbase4:40159] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs 2023-09-27 22:03:20,983 INFO [RS:2;jenkins-hbase4:40159] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40159%2C1695852059137:(num 1695852060770) 2023-09-27 22:03:20,983 DEBUG [RS:2;jenkins-hbase4:40159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:20,983 INFO [RS:2;jenkins-hbase4:40159] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:20,983 INFO [RS:2;jenkins-hbase4:40159] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 22:03:20,984 INFO [RS:2;jenkins-hbase4:40159] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 22:03:20,984 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 22:03:20,984 INFO [RS:2;jenkins-hbase4:40159] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 22:03:20,984 INFO [RS:2;jenkins-hbase4:40159] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 22:03:20,985 INFO [RS:2;jenkins-hbase4:40159] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40159 2023-09-27 22:03:20,987 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:03:20,987 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40159,1695852059137 2023-09-27 22:03:20,987 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:20,988 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40159,1695852059137] 2023-09-27 22:03:20,988 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40159,1695852059137; numProcessing=2 2023-09-27 22:03:20,989 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40159,1695852059137 already deleted, retry=false 2023-09-27 22:03:20,989 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40159,1695852059137 expired; onlineServers=1 2023-09-27 22:03:21,088 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,088 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:40159-0x100ef6808bf0003, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,088 INFO [RS:2;jenkins-hbase4:40159] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40159,1695852059137; zookeeper connection closed. 2023-09-27 22:03:21,089 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1c7bb882] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1c7bb882 2023-09-27 22:03:21,178 DEBUG [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 22:03:21,241 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/rep_barrier/10d26c007d4b4471bd44b47491add845 2023-09-27 22:03:21,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10d26c007d4b4471bd44b47491add845 2023-09-27 22:03:21,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/table/96c3e52402d341948f275005f4537fc0 2023-09-27 22:03:21,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96c3e52402d341948f275005f4537fc0 2023-09-27 22:03:21,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/info/05dc0d059b2c45b8861a08123f7f4aa7 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/info/05dc0d059b2c45b8861a08123f7f4aa7 2023-09-27 22:03:21,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05dc0d059b2c45b8861a08123f7f4aa7 2023-09-27 22:03:21,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/info/05dc0d059b2c45b8861a08123f7f4aa7, entries=48, sequenceid=131, filesize=10.3 K 2023-09-27 22:03:21,265 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/rep_barrier/10d26c007d4b4471bd44b47491add845 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/rep_barrier/10d26c007d4b4471bd44b47491add845 2023-09-27 22:03:21,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10d26c007d4b4471bd44b47491add845 2023-09-27 22:03:21,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/rep_barrier/10d26c007d4b4471bd44b47491add845, entries=13, sequenceid=131, filesize=6.4 K 2023-09-27 22:03:21,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/.tmp/table/96c3e52402d341948f275005f4537fc0 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/table/96c3e52402d341948f275005f4537fc0 2023-09-27 22:03:21,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96c3e52402d341948f275005f4537fc0 2023-09-27 22:03:21,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/table/96c3e52402d341948f275005f4537fc0, entries=24, sequenceid=131, filesize=6.9 K 2023-09-27 22:03:21,275 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 496ms, sequenceid=131, compaction requested=false 2023-09-27 22:03:21,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-27 22:03:21,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 22:03:21,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 22:03:21,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 22:03:21,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 22:03:21,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-27 22:03:21,378 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32927,1695852059054; all regions closed. 2023-09-27 22:03:21,384 DEBUG [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs 2023-09-27 22:03:21,384 INFO [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32927%2C1695852059054.meta:.meta(num 1695852060906) 2023-09-27 22:03:21,390 DEBUG [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/oldWALs 2023-09-27 22:03:21,390 INFO [RS:0;jenkins-hbase4:32927] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32927%2C1695852059054:(num 1695852060770) 2023-09-27 22:03:21,390 DEBUG [RS:0;jenkins-hbase4:32927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:21,390 INFO [RS:0;jenkins-hbase4:32927] regionserver.LeaseManager(133): Closed leases 2023-09-27 22:03:21,390 INFO [RS:0;jenkins-hbase4:32927] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 22:03:21,390 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 22:03:21,391 INFO [RS:0;jenkins-hbase4:32927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32927 2023-09-27 22:03:21,394 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 22:03:21,394 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32927,1695852059054 2023-09-27 22:03:21,395 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32927,1695852059054] 2023-09-27 22:03:21,395 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32927,1695852059054; numProcessing=3 2023-09-27 22:03:21,396 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32927,1695852059054 already deleted, retry=false 2023-09-27 22:03:21,396 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32927,1695852059054 expired; onlineServers=0 2023-09-27 22:03:21,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45673,1695852057804' ***** 2023-09-27 22:03:21,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-27 22:03:21,396 DEBUG [M:0;jenkins-hbase4:45673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bd6d36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 22:03:21,396 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45673,1695852057804 2023-09-27 22:03:21,396 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45673,1695852057804; all regions closed. 2023-09-27 22:03:21,396 DEBUG [M:0;jenkins-hbase4:45673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 22:03:21,396 DEBUG [M:0;jenkins-hbase4:45673] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-27 22:03:21,396 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-27 22:03:21,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695852060392] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695852060392,5,FailOnTimeoutGroup] 2023-09-27 22:03:21,397 DEBUG [M:0;jenkins-hbase4:45673] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-27 22:03:21,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695852060392] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695852060392,5,FailOnTimeoutGroup] 2023-09-27 22:03:21,397 INFO [M:0;jenkins-hbase4:45673] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-27 22:03:21,397 INFO [M:0;jenkins-hbase4:45673] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-27 22:03:21,397 INFO [M:0;jenkins-hbase4:45673] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-27 22:03:21,397 DEBUG [M:0;jenkins-hbase4:45673] master.HMaster(1512): Stopping service threads 2023-09-27 22:03:21,397 INFO [M:0;jenkins-hbase4:45673] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-27 22:03:21,397 ERROR [M:0;jenkins-hbase4:45673] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-27 22:03:21,398 INFO [M:0;jenkins-hbase4:45673] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-27 22:03:21,398 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-27 22:03:21,398 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-27 22:03:21,398 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 22:03:21,398 DEBUG [M:0;jenkins-hbase4:45673] zookeeper.ZKUtil(398): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-27 22:03:21,398 WARN [M:0;jenkins-hbase4:45673] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-27 22:03:21,398 INFO [M:0;jenkins-hbase4:45673] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-27 22:03:21,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 22:03:21,399 INFO [M:0;jenkins-hbase4:45673] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-27 22:03:21,399 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 22:03:21,399 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:03:21,399 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:03:21,399 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 22:03:21,399 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:03:21,399 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.70 KB heapSize=451.92 KB 2023-09-27 22:03:21,414 INFO [M:0;jenkins-hbase4:45673] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.70 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/302e6f51d82d44dfb52dcf4fc1a94980 2023-09-27 22:03:21,418 INFO [M:0;jenkins-hbase4:45673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 302e6f51d82d44dfb52dcf4fc1a94980 2023-09-27 22:03:21,419 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/302e6f51d82d44dfb52dcf4fc1a94980 as hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/302e6f51d82d44dfb52dcf4fc1a94980 2023-09-27 22:03:21,422 INFO [M:0;jenkins-hbase4:45673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 302e6f51d82d44dfb52dcf4fc1a94980 2023-09-27 22:03:21,423 INFO [M:0;jenkins-hbase4:45673] regionserver.HStore(1080): Added hdfs://localhost:36545/user/jenkins/test-data/7588ef69-4da4-fa28-60bf-f19463c4f5d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/302e6f51d82d44dfb52dcf4fc1a94980, entries=119, sequenceid=899, filesize=28.6 K 2023-09-27 22:03:21,423 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegion(2948): Finished flush of dataSize ~375.70 KB/384713, heapSize ~451.91 KB/462752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-27 22:03:21,425 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 22:03:21,425 DEBUG [M:0;jenkins-hbase4:45673] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 22:03:21,431 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 22:03:21,431 INFO [M:0;jenkins-hbase4:45673] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-27 22:03:21,432 INFO [M:0;jenkins-hbase4:45673] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45673 2023-09-27 22:03:21,434 DEBUG [M:0;jenkins-hbase4:45673] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45673,1695852057804 already deleted, retry=false 2023-09-27 22:03:21,495 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,495 INFO [RS:0;jenkins-hbase4:32927] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32927,1695852059054; zookeeper connection closed. 2023-09-27 22:03:21,495 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): regionserver:32927-0x100ef6808bf0001, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,495 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e760bd5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e760bd5 2023-09-27 22:03:21,495 INFO [Listener at jenkins-hbase4.apache.org/37371] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-27 22:03:21,595 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,595 DEBUG [Listener at localhost/42973-EventThread] zookeeper.ZKWatcher(600): master:45673-0x100ef6808bf0000, quorum=127.0.0.1:51065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 22:03:21,595 INFO [M:0;jenkins-hbase4:45673] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45673,1695852057804; zookeeper connection closed. 2023-09-27 22:03:21,597 WARN [Listener at jenkins-hbase4.apache.org/37371] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 22:03:21,599 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 22:03:21,702 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 22:03:21,702 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-842554181-172.31.14.131-1695852054078 (Datanode Uuid a16a8bb4-870b-48a6-b604-51689286974a) service to localhost/127.0.0.1:36545 2023-09-27 22:03:21,704 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data5/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,704 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data6/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,705 WARN [Listener at jenkins-hbase4.apache.org/37371] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 22:03:21,707 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 22:03:21,810 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 22:03:21,810 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-842554181-172.31.14.131-1695852054078 (Datanode Uuid 40dba600-1c9c-48e2-abba-311aff7db389) service to localhost/127.0.0.1:36545 2023-09-27 22:03:21,811 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data3/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,811 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data4/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,812 WARN [Listener at jenkins-hbase4.apache.org/37371] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 22:03:21,814 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 22:03:21,918 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 22:03:21,918 WARN [BP-842554181-172.31.14.131-1695852054078 heartbeating to localhost/127.0.0.1:36545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-842554181-172.31.14.131-1695852054078 (Datanode Uuid f8eff38c-abdc-46d8-91f3-d5be8d05dfab) service to localhost/127.0.0.1:36545 2023-09-27 22:03:21,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data1/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd1d5c84-db58-0053-dd73-8ceb25646ab6/cluster_56c5439b-dd90-aeaa-aaa0-65e8bd22baa6/dfs/data/data2/current/BP-842554181-172.31.14.131-1695852054078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 22:03:21,939 INFO [Listener at jenkins-hbase4.apache.org/37371] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 22:03:22,065 INFO [Listener at jenkins-hbase4.apache.org/37371] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-27 22:03:22,158 INFO [Listener at jenkins-hbase4.apache.org/37371] hbase.HBaseTestingUtility(1293): Minicluster is down