2023-11-22 10:53:14,647 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-22 10:53:14,891 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56 2023-11-22 10:53:14,907 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-22 10:53:14,907 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf, deleteOnExit=true 2023-11-22 10:53:14,908 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-22 10:53:14,908 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/test.cache.data in system properties and HBase conf 2023-11-22 10:53:14,909 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/hadoop.tmp.dir in system properties and HBase conf 2023-11-22 10:53:14,909 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/hadoop.log.dir in system properties and HBase conf 2023-11-22 10:53:14,909 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-22 10:53:14,910 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-22 10:53:14,910 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-22 10:53:15,043 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-22 10:53:15,463 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-22 10:53:15,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-22 10:53:15,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-22 10:53:15,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-22 10:53:15,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-22 10:53:15,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-22 10:53:15,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-22 10:53:15,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-22 10:53:15,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-22 10:53:15,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-22 10:53:15,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/nfs.dump.dir in system properties and HBase conf 2023-11-22 10:53:15,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/java.io.tmpdir in system properties and HBase conf 2023-11-22 10:53:15,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-22 10:53:15,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-22 10:53:15,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-22 10:53:16,082 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-22 10:53:16,087 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-22 10:53:16,392 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-22 10:53:16,572 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-22 10:53:16,593 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-22 10:53:16,633 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-22 10:53:16,665 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/java.io.tmpdir/Jetty_localhost_43011_hdfs____hteivv/webapp 2023-11-22 10:53:16,812 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43011 2023-11-22 10:53:16,822 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-22 10:53:16,823 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-22 10:53:17,390 WARN [Listener at localhost/42673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-22 10:53:17,469 WARN [Listener at localhost/42673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-22 10:53:17,492 WARN [Listener at localhost/42673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-22 10:53:17,499 INFO [Listener at localhost/42673] log.Slf4jLog(67): jetty-6.1.26 2023-11-22 10:53:17,504 INFO [Listener at localhost/42673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/java.io.tmpdir/Jetty_localhost_46089_datanode____.60muy2/webapp 2023-11-22 10:53:17,607 INFO [Listener at localhost/42673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46089 2023-11-22 10:53:18,002 WARN [Listener at localhost/45227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-22 10:53:18,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde24b494b17af4e6: Processing first storage report for DS-d94468c4-b138-406d-9b61-f42cce7765ff from datanode 576887cb-ebf2-41c9-9de2-6bb11603a0c6 2023-11-22 10:53:18,574 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde24b494b17af4e6: from storage DS-d94468c4-b138-406d-9b61-f42cce7765ff node DatanodeRegistration(127.0.0.1:46037, datanodeUuid=576887cb-ebf2-41c9-9de2-6bb11603a0c6, infoPort=45831, infoSecurePort=0, ipcPort=45227, storageInfo=lv=-57;cid=testClusterID;nsid=878032004;c=1700650396166), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-22 10:53:18,574 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde24b494b17af4e6: Processing first storage report for DS-69e09f4e-bea3-4ab8-b5fe-99a32354b16c from datanode 576887cb-ebf2-41c9-9de2-6bb11603a0c6 2023-11-22 10:53:18,575 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde24b494b17af4e6: from storage DS-69e09f4e-bea3-4ab8-b5fe-99a32354b16c node DatanodeRegistration(127.0.0.1:46037, datanodeUuid=576887cb-ebf2-41c9-9de2-6bb11603a0c6, infoPort=45831, infoSecurePort=0, ipcPort=45227, storageInfo=lv=-57;cid=testClusterID;nsid=878032004;c=1700650396166), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-22 10:53:18,645 DEBUG [Listener at localhost/45227] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56 2023-11-22 10:53:18,763 INFO [Listener at localhost/45227] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/zookeeper_0, clientPort=57046, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-22 10:53:18,777 INFO [Listener at localhost/45227] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57046 2023-11-22 10:53:18,784 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:18,786 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:19,476 INFO [Listener at localhost/45227] util.FSUtils(471): Created version file at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b with version=8 2023-11-22 10:53:19,476 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/hbase-staging 2023-11-22 10:53:19,775 INFO [Listener at localhost/45227] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-22 10:53:20,232 INFO [Listener at localhost/45227] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-22 10:53:20,263 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,264 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,264 INFO [Listener at localhost/45227] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-22 10:53:20,264 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,264 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-22 10:53:20,454 INFO [Listener at localhost/45227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-22 10:53:20,528 DEBUG [Listener at localhost/45227] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-22 10:53:20,621 INFO [Listener at localhost/45227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41509 2023-11-22 10:53:20,631 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:20,633 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:20,655 INFO [Listener at localhost/45227] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41509 connecting to ZooKeeper ensemble=127.0.0.1:57046 2023-11-22 10:53:20,698 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:415090x0, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-22 10:53:20,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41509-0x10014b998340000 connected 2023-11-22 10:53:20,736 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-22 10:53:20,737 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-22 10:53:20,740 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-22 10:53:20,748 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41509 2023-11-22 10:53:20,749 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41509 2023-11-22 10:53:20,750 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41509 2023-11-22 10:53:20,752 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41509 2023-11-22 10:53:20,753 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41509 2023-11-22 10:53:20,759 INFO [Listener at localhost/45227] master.HMaster(444): hbase.rootdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b, hbase.cluster.distributed=false 2023-11-22 10:53:20,832 INFO [Listener at localhost/45227] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-22 10:53:20,832 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,832 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,833 INFO [Listener at localhost/45227] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-22 10:53:20,833 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-22 10:53:20,833 INFO [Listener at localhost/45227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-22 10:53:20,838 INFO [Listener at localhost/45227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-22 10:53:20,841 INFO [Listener at localhost/45227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46051 2023-11-22 10:53:20,844 INFO [Listener at localhost/45227] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-22 10:53:20,851 DEBUG [Listener at localhost/45227] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-22 10:53:20,852 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:20,855 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:20,858 INFO [Listener at localhost/45227] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46051 connecting to ZooKeeper ensemble=127.0.0.1:57046 2023-11-22 10:53:20,862 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:460510x0, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-22 10:53:20,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46051-0x10014b998340001 connected 2023-11-22 10:53:20,863 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-22 10:53:20,864 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-22 10:53:20,865 DEBUG [Listener at localhost/45227] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-22 10:53:20,866 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46051 2023-11-22 10:53:20,868 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46051 2023-11-22 10:53:20,868 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46051 2023-11-22 10:53:20,869 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46051 2023-11-22 10:53:20,869 DEBUG [Listener at localhost/45227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46051 2023-11-22 10:53:20,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:20,880 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-22 10:53:20,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:20,906 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-22 10:53:20,906 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-22 10:53:20,906 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:20,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-22 10:53:20,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-22 10:53:20,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41509,1700650399619 from backup master directory 2023-11-22 10:53:20,912 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:20,912 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-22 10:53:20,913 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-22 10:53:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-22 10:53:20,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-22 10:53:20,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/hbase.id with ID: f0bd793f-ad1a-4013-91e6-f53e820a0a35 2023-11-22 10:53:21,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:21,058 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:21,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x11bf69bc to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:21,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@493c7a20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:21,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-22 10:53:21,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-22 10:53:21,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-22 10:53:21,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-22 10:53:21,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-22 10:53:21,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-22 10:53:21,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-22 10:53:21,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store-tmp 2023-11-22 10:53:21,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:21,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-22 10:53:21,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:53:21,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:53:21,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-22 10:53:21,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:53:21,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:53:21,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-22 10:53:21,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/WALs/jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:21,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41509%2C1700650399619, suffix=, logDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/WALs/jenkins-hbase4.apache.org,41509,1700650399619, archiveDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/oldWALs, maxLogs=10 2023-11-22 10:53:21,352 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK] 2023-11-22 10:53:21,363 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-22 10:53:21,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/WALs/jenkins-hbase4.apache.org,41509,1700650399619/jenkins-hbase4.apache.org%2C41509%2C1700650399619.1700650401286 2023-11-22 10:53:21,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK]] 2023-11-22 10:53:21,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:21,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,514 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-22 10:53:21,541 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-22 10:53:21,553 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:21,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-22 10:53:21,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:21,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67289405, jitterRate=0.0026902705430984497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:21,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-22 10:53:21,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-22 10:53:21,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-22 10:53:21,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-22 10:53:21,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-22 10:53:21,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-22 10:53:21,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-11-22 10:53:21,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-22 10:53:21,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-22 10:53:21,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-22 10:53:21,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-22 10:53:21,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-22 10:53:21,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-22 10:53:21,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-22 10:53:21,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-22 10:53:21,726 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:21,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-22 10:53:21,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-22 10:53:21,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-22 10:53:21,747 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-22 10:53:21,747 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-22 10:53:21,748 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:21,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41509,1700650399619, sessionid=0x10014b998340000, setting cluster-up flag (Was=false) 2023-11-22 10:53:21,766 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:21,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-22 10:53:21,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:21,783 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:21,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-22 10:53:21,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:21,796 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp 2023-11-22 10:53:21,874 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(951): ClusterId : f0bd793f-ad1a-4013-91e6-f53e820a0a35 2023-11-22 10:53:21,880 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-22 10:53:21,889 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-22 10:53:21,889 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-22 10:53:21,893 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-22 10:53:21,896 DEBUG [RS:0;jenkins-hbase4:46051] zookeeper.ReadOnlyZKClient(139): Connect 0x76dca759 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:21,902 DEBUG [RS:0;jenkins-hbase4:46051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@781b47f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:21,903 DEBUG [RS:0;jenkins-hbase4:46051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c24cc29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-22 10:53:21,933 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46051 2023-11-22 10:53:21,939 INFO [RS:0;jenkins-hbase4:46051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-22 10:53:21,939 INFO [RS:0;jenkins-hbase4:46051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-22 10:53:21,939 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1022): About to register with Master. 2023-11-22 10:53:21,942 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41509,1700650399619 with isa=jenkins-hbase4.apache.org/172.31.14.131:46051, startcode=1700650400831 2023-11-22 10:53:21,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-22 10:53:21,958 DEBUG [RS:0;jenkins-hbase4:46051] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-22 10:53:21,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-22 10:53:21,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-22 10:53:21,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-22 10:53:21,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-22 10:53:21,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-22 10:53:21,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:21,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-22 10:53:21,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:21,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700650431974 2023-11-22 10:53:21,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-22 10:53:21,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-22 10:53:21,992 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-22 10:53:21,992 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-22 10:53:21,999 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-22 10:53:21,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-22 10:53:22,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-22 10:53:22,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-22 10:53:22,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-22 10:53:22,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-22 10:53:22,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-22 10:53:22,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-22 10:53:22,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-22 10:53:22,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-22 10:53:22,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700650402019,5,FailOnTimeoutGroup] 2023-11-22 10:53:22,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700650402020,5,FailOnTimeoutGroup] 2023-11-22 10:53:22,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-22 10:53:22,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,028 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59455, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-22 10:53:22,051 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:22,053 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:22,053 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b 2023-11-22 10:53:22,055 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41509] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,076 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b 2023-11-22 10:53:22,076 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42673 2023-11-22 10:53:22,076 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-22 10:53:22,083 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-22 10:53:22,084 DEBUG [RS:0;jenkins-hbase4:46051] zookeeper.ZKUtil(162): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,084 WARN [RS:0;jenkins-hbase4:46051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-22 10:53:22,084 INFO [RS:0;jenkins-hbase4:46051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-22 10:53:22,085 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/WALs/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,085 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46051,1700650400831] 2023-11-22 10:53:22,093 DEBUG [RS:0;jenkins-hbase4:46051] zookeeper.ZKUtil(162): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,103 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-22 10:53:22,111 INFO [RS:0;jenkins-hbase4:46051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-22 10:53:22,128 INFO [RS:0;jenkins-hbase4:46051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-22 10:53:22,132 INFO [RS:0;jenkins-hbase4:46051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:53:22,132 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,133 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-22 10:53:22,140 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,141 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,141 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,141 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,141 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,141 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,142 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-22 10:53:22,142 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,142 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,142 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,142 DEBUG [RS:0;jenkins-hbase4:46051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-22 10:53:22,143 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,143 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,143 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,165 INFO [RS:0;jenkins-hbase4:46051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-22 10:53:22,168 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46051,1700650400831-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:22,190 INFO [RS:0;jenkins-hbase4:46051] regionserver.Replication(203): jenkins-hbase4.apache.org,46051,1700650400831 started 2023-11-22 10:53:22,191 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46051,1700650400831, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46051, sessionid=0x10014b998340001 2023-11-22 10:53:22,191 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-22 10:53:22,191 DEBUG [RS:0;jenkins-hbase4:46051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,191 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46051,1700650400831' 2023-11-22 10:53:22,191 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:22,192 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:22,193 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-22 10:53:22,193 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-22 10:53:22,193 DEBUG [RS:0;jenkins-hbase4:46051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,193 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46051,1700650400831' 2023-11-22 10:53:22,193 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-22 10:53:22,194 DEBUG [RS:0;jenkins-hbase4:46051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-22 10:53:22,195 DEBUG [RS:0;jenkins-hbase4:46051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-22 10:53:22,195 INFO [RS:0;jenkins-hbase4:46051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-22 10:53:22,195 INFO [RS:0;jenkins-hbase4:46051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-22 10:53:22,308 INFO [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46051%2C1700650400831, suffix=, logDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/WALs/jenkins-hbase4.apache.org,46051,1700650400831, archiveDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/oldWALs, maxLogs=32 2023-11-22 10:53:22,337 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK] 2023-11-22 10:53:22,342 INFO [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/WALs/jenkins-hbase4.apache.org,46051,1700650400831/jenkins-hbase4.apache.org%2C46051%2C1700650400831.1700650402311 2023-11-22 10:53:22,343 DEBUG [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK]] 2023-11-22 10:53:22,475 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:22,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-22 10:53:22,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/info 2023-11-22 10:53:22,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-22 10:53:22,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-22 10:53:22,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/rep_barrier 2023-11-22 10:53:22,490 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-22 10:53:22,490 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,491 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-22 10:53:22,493 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/table 2023-11-22 10:53:22,494 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-22 10:53:22,495 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,496 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740 2023-11-22 10:53:22,497 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740 2023-11-22 10:53:22,502 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-22 10:53:22,504 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-22 10:53:22,508 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:22,509 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71138138, jitterRate=0.06004086136817932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-22 10:53:22,510 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-22 10:53:22,510 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-22 10:53:22,510 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-22 10:53:22,510 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-22 10:53:22,510 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-22 10:53:22,510 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-22 10:53:22,511 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-22 10:53:22,512 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-22 10:53:22,517 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-22 10:53:22,517 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-22 10:53:22,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-22 10:53:22,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-22 10:53:22,544 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-22 10:53:22,696 DEBUG [jenkins-hbase4:41509] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-22 10:53:22,699 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46051,1700650400831, state=OPENING 2023-11-22 10:53:22,707 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-22 10:53:22,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:22,710 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-22 10:53:22,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:22,896 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:22,898 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-22 10:53:22,902 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-22 10:53:22,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-22 10:53:22,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-22 10:53:22,915 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46051%2C1700650400831.meta, suffix=.meta, logDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/WALs/jenkins-hbase4.apache.org,46051,1700650400831, archiveDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/oldWALs, maxLogs=32 2023-11-22 10:53:22,931 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK] 2023-11-22 10:53:22,935 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/WALs/jenkins-hbase4.apache.org,46051,1700650400831/jenkins-hbase4.apache.org%2C46051%2C1700650400831.meta.1700650402916.meta 2023-11-22 10:53:22,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46037,DS-d94468c4-b138-406d-9b61-f42cce7765ff,DISK]] 2023-11-22 10:53:22,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:22,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-22 10:53:22,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-22 10:53:22,958 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-22 10:53:22,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-22 10:53:22,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:22,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-22 10:53:22,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-22 10:53:22,966 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-22 10:53:22,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/info 2023-11-22 10:53:22,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/info 2023-11-22 10:53:22,969 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-22 10:53:22,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-22 10:53:22,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/rep_barrier 2023-11-22 10:53:22,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/rep_barrier 2023-11-22 10:53:22,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-22 10:53:22,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-22 10:53:22,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/table 2023-11-22 10:53:22,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/table 2023-11-22 10:53:22,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-22 10:53:22,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:22,978 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740 2023-11-22 10:53:22,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740 2023-11-22 10:53:22,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-22 10:53:22,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-22 10:53:22,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69919676, jitterRate=0.04188436269760132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-22 10:53:22,989 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-22 10:53:22,998 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700650402889 2023-11-22 10:53:23,017 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-22 10:53:23,018 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-22 10:53:23,018 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46051,1700650400831, state=OPEN 2023-11-22 10:53:23,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-22 10:53:23,027 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-22 10:53:23,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=3, resume processing ppid=2 2023-11-22 10:53:23,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46051,1700650400831 in 315 msec 2023-11-22 10:53:23,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=2, resume processing ppid=1 2023-11-22 10:53:23,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 506 msec 2023-11-22 10:53:23,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1770 sec 2023-11-22 10:53:23,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700650403042, completionTime=-1 2023-11-22 10:53:23,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-22 10:53:23,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-22 10:53:23,117 DEBUG [hconnection-0x7a820993-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:23,121 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:23,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-22 10:53:23,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700650463138 2023-11-22 10:53:23,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700650523138 2023-11-22 10:53:23,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 95 msec 2023-11-22 10:53:23,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41509,1700650399619-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:23,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41509,1700650399619-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:23,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41509,1700650399619-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:23,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41509, period=300000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:23,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-22 10:53:23,174 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-22 10:53:23,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-22 10:53:23,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-22 10:53:23,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-22 10:53:23,197 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:53:23,200 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:53:23,223 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:23,225 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2 empty. 2023-11-22 10:53:23,226 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:23,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-22 10:53:23,649 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:23,651 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2d78f1fe8e03e176b334fe13f0b8aea2, NAME => 'hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:53:24,063 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:24,063 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2d78f1fe8e03e176b334fe13f0b8aea2, disabling compactions & flushes 2023-11-22 10:53:24,063 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,063 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,063 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. after waiting 0 ms 2023-11-22 10:53:24,063 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,063 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2d78f1fe8e03e176b334fe13f0b8aea2: 2023-11-22 10:53:24,068 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:53:24,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700650404071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650404071"}]},"ts":"1700650404071"} 2023-11-22 10:53:24,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:53:24,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:53:24,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650404114"}]},"ts":"1700650404114"} 2023-11-22 10:53:24,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-22 10:53:24,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2d78f1fe8e03e176b334fe13f0b8aea2, ASSIGN}] 2023-11-22 10:53:24,135 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2d78f1fe8e03e176b334fe13f0b8aea2, ASSIGN 2023-11-22 10:53:24,136 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2d78f1fe8e03e176b334fe13f0b8aea2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:53:24,288 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2d78f1fe8e03e176b334fe13f0b8aea2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:24,288 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700650404287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650404287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650404287"}]},"ts":"1700650404287"} 2023-11-22 10:53:24,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2d78f1fe8e03e176b334fe13f0b8aea2, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:24,446 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:24,454 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d78f1fe8e03e176b334fe13f0b8aea2, NAME => 'hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:24,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:24,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,458 INFO [StoreOpener-2d78f1fe8e03e176b334fe13f0b8aea2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,460 DEBUG [StoreOpener-2d78f1fe8e03e176b334fe13f0b8aea2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/info 2023-11-22 10:53:24,460 DEBUG [StoreOpener-2d78f1fe8e03e176b334fe13f0b8aea2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/info 2023-11-22 10:53:24,461 INFO [StoreOpener-2d78f1fe8e03e176b334fe13f0b8aea2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d78f1fe8e03e176b334fe13f0b8aea2 columnFamilyName info 2023-11-22 10:53:24,461 INFO [StoreOpener-2d78f1fe8e03e176b334fe13f0b8aea2-1] regionserver.HStore(310): Store=2d78f1fe8e03e176b334fe13f0b8aea2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:24,463 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:53:24,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:24,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d78f1fe8e03e176b334fe13f0b8aea2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67186111, jitterRate=0.00115106999874115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:24,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d78f1fe8e03e176b334fe13f0b8aea2: 2023-11-22 10:53:24,475 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2., pid=6, masterSystemTime=1700650404446 2023-11-22 10:53:24,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,478 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:53:24,480 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2d78f1fe8e03e176b334fe13f0b8aea2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:24,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700650404479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650404479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650404479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650404479"}]},"ts":"1700650404479"} 2023-11-22 10:53:24,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=6, resume processing ppid=5 2023-11-22 10:53:24,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2d78f1fe8e03e176b334fe13f0b8aea2, server=jenkins-hbase4.apache.org,46051,1700650400831 in 191 msec 2023-11-22 10:53:24,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=5, resume processing ppid=4 2023-11-22 10:53:24,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2d78f1fe8e03e176b334fe13f0b8aea2, ASSIGN in 356 msec 2023-11-22 10:53:24,492 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:53:24,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650404492"}]},"ts":"1700650404492"} 2023-11-22 10:53:24,495 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-22 10:53:24,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:53:24,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-22 10:53:24,501 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-22 10:53:24,501 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:53:24,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3120 sec 2023-11-22 10:53:24,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-22 10:53:24,546 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-22 10:53:24,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-11-22 10:53:24,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-22 10:53:24,574 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-22 10:53:24,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-11-22 10:53:24,591 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-22 10:53:24,594 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-22 10:53:24,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.682sec 2023-11-22 10:53:24,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-22 10:53:24,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-22 10:53:24,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-22 10:53:24,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41509,1700650399619-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-22 10:53:24,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41509,1700650399619-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-22 10:53:24,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-22 10:53:24,681 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(139): Connect 0x42f95205 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:24,686 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd83e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:24,699 DEBUG [hconnection-0x18b1d570-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:24,710 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:24,721 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:53:24,723 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(139): Connect 0x2131ff51 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:24,731 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37318dfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:24,731 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:53:24,789 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=171, AvailableMemoryMB=10315 2023-11-22 10:53:24,801 DEBUG [Listener at localhost/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:53:24,804 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:53:24,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:53:24,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:24,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:53:24,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:53:24,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-22 10:53:24,825 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:24,826 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 empty. 2023-11-22 10:53:24,828 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:24,828 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-22 10:53:24,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-22 10:53:24,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-22 10:53:25,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-22 10:53:25,247 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:25,250 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ad6a67058299bbff56bafe728260442, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:53:25,278 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:25,278 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 0ad6a67058299bbff56bafe728260442, disabling compactions & flushes 2023-11-22 10:53:25,278 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,279 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,279 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. after waiting 0 ms 2023-11-22 10:53:25,279 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,279 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,279 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:25,283 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:53:25,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650405284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650405284"}]},"ts":"1700650405284"} 2023-11-22 10:53:25,287 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:53:25,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:53:25,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650405289"}]},"ts":"1700650405289"} 2023-11-22 10:53:25,291 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-22 10:53:25,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, ASSIGN}] 2023-11-22 10:53:25,298 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, ASSIGN 2023-11-22 10:53:25,299 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:53:25,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-22 10:53:25,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:25,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650405450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650405450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650405450"}]},"ts":"1700650405450"} 2023-11-22 10:53:25,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:25,608 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:25,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ad6a67058299bbff56bafe728260442, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:25,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,618 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,620 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:25,620 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:25,623 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ad6a67058299bbff56bafe728260442 columnFamilyName family1 2023-11-22 10:53:25,627 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(310): Store=0ad6a67058299bbff56bafe728260442/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:25,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:25,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:25,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ad6a67058299bbff56bafe728260442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65700284, jitterRate=-0.02098947763442993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:25,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:25,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., pid=11, masterSystemTime=1700650405608 2023-11-22 10:53:25,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:25,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:25,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650405651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650405651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650405651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650405651"}]},"ts":"1700650405651"} 2023-11-22 10:53:25,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=11, resume processing ppid=10 2023-11-22 10:53:25,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831 in 201 msec 2023-11-22 10:53:25,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=10, resume processing ppid=9 2023-11-22 10:53:25,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, ASSIGN in 363 msec 2023-11-22 10:53:25,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:53:25,664 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650405664"}]},"ts":"1700650405664"} 2023-11-22 10:53:25,667 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-22 10:53:25,671 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:53:25,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 855 msec 2023-11-22 10:53:25,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-22 10:53:25,952 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-22 10:53:25,974 DEBUG [hconnection-0x236d8801-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:25,982 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:26,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:26,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,149 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:26,149 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:26,150 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:26,150 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:26,151 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,151 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,153 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:26,153 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:26,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:26,154 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,154 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:26,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,156 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:26,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:26,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:26,159 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:26,159 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:26,159 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:26,160 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:26,161 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:53:26,718 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130793b90523c4546f9804675bbfe4f95f5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130793b90523c4546f9804675bbfe4f95f5 2023-11-22 10:53:26,734 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/22b8b9f4196348a2bcd25baa29efb089 2023-11-22 10:53:26,746 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/22b8b9f4196348a2bcd25baa29efb089 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089 2023-11-22 10:53:26,756 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-22 10:53:26,759 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 598ms, sequenceid=5, compaction requested=false 2023-11-22 10:53:26,761 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:26,765 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:26,765 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:26,765 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:26,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:26,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:26,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:26,771 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,771 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:26,772 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,772 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:26,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:26,776 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:26,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fd974db[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:26,776 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,778 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:26,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:26,783 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:26,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:26,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:26,790 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:26,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:26,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:26,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,790 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:26,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:26,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:26,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:26,800 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,805 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:26,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,816 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:26,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:26,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:26,816 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,819 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:26,819 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:26,820 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:26,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:26,920 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:26,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:26,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:26,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:26,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,949 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:26,949 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:26,950 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:26,950 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:26,951 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,951 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,963 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:26,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:26,963 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,964 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:26,964 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:26,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,965 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:26,965 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:26,966 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:26,966 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:26,967 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:53:26,998 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128860b4f7aa797473681f35ef128f79583 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128860b4f7aa797473681f35ef128f79583 2023-11-22 10:53:27,422 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/21ced1f177844bff888a2c6e1a66b23b 2023-11-22 10:53:27,432 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/21ced1f177844bff888a2c6e1a66b23b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b 2023-11-22 10:53:27,441 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:53:27,442 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 475ms, sequenceid=9, compaction requested=false 2023-11-22 10:53:27,443 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:27,443 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:27,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:27,444 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:27,444 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,444 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:27,444 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:27,448 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:27,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:27,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:27,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c18233[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:27,451 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:27,451 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,453 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,453 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:27,453 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:27,453 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:27,453 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,454 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:27,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:27,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:27,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:27,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:27,464 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:27,464 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:27,464 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:27,464 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,464 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:27,467 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,467 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,467 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:27,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:27,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:27,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:27,469 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,471 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:27,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:27,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:27,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,479 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,479 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,479 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,479 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:27,479 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:27,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:27,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:27,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:27,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:27,480 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:27,480 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:27,581 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:27,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:27,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:27,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:27,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,601 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:27,601 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:27,601 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:27,601 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:27,602 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,602 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,604 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:27,604 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:27,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:27,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:27,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,607 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,607 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:27,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:27,608 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:27,608 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:27,608 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:27,695 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201072118d762a24960a6174e5dd5cd19e3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201072118d762a24960a6174e5dd5cd19e3 2023-11-22 10:53:28,140 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/340c5d39127b4b96805308fa81f6ac5b 2023-11-22 10:53:28,152 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/340c5d39127b4b96805308fa81f6ac5b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b 2023-11-22 10:53:28,162 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-22 10:53:28,163 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 555ms, sequenceid=13, compaction requested=true 2023-11-22 10:53:28,163 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:28,163 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:28,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,167 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,168 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,168 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:28,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5494e5e[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:28,171 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:28,172 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,173 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:28,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:28,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:28,174 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,174 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:28,176 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,176 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:28,176 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:28,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,176 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:28,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:28,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:28,183 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:28,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:28,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:28,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,184 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:28,186 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,186 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,186 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:28,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:28,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:28,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,188 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,190 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,195 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:28,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:28,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:28,196 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:28,196 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:28,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:28,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:28,197 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:28,197 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:28,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:28,297 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:28,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:28,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:28,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:28,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,310 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:28,311 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:28,311 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:28,311 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:28,312 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,312 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,314 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:28,314 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:28,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:28,315 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,315 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:28,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:28,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:28,317 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:28,317 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:28,317 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:28,346 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120509bba6d3c592467da7fb1afc87713c4d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509bba6d3c592467da7fb1afc87713c4d 2023-11-22 10:53:28,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:53:28,572 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-22 10:53:28,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-22 10:53:28,761 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/596b29a1877b4203a5bf1d8fcfcc9a44 2023-11-22 10:53:28,771 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/596b29a1877b4203a5bf1d8fcfcc9a44 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44 2023-11-22 10:53:28,781 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44, entries=1, sequenceid=17, filesize=5.0 K 2023-11-22 10:53:28,782 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 465ms, sequenceid=17, compaction requested=true 2023-11-22 10:53:28,782 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:28,783 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:28,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:28,787 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,787 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,788 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,788 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:28,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f591214[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:28,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:28,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,793 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:28,793 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,793 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:28,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:28,797 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:28,800 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:28,801 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:28,801 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:28,801 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,801 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:28,807 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,807 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,807 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:28,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:28,808 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,812 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:28,818 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:28,819 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:28,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:28,819 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:28,819 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,820 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,820 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:28,820 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:28,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:28,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:28,920 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:28,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:28,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:28,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:28,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,932 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:28,932 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:28,933 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:28,933 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:28,933 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,934 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,937 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:28,937 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:28,937 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:28,937 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:28,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:28,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:28,940 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:28,940 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:28,940 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:28,940 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:28,940 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:29,363 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228061623ed0a9547afa6f7060a1bd8170c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228061623ed0a9547afa6f7060a1bd8170c 2023-11-22 10:53:29,379 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/abfd869ee1854934a469ffd5e5082865 2023-11-22 10:53:29,388 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/abfd869ee1854934a469ffd5e5082865 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865 2023-11-22 10:53:29,399 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865, entries=1, sequenceid=21, filesize=5.0 K 2023-11-22 10:53:29,400 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 460ms, sequenceid=21, compaction requested=true 2023-11-22 10:53:29,401 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:29,401 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:29,404 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:29,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,405 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:29,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:29,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ba2ce88[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:29,407 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:29,407 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,409 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:29,410 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,410 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:29,412 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:29,412 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,412 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:29,412 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:29,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:29,417 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:29,417 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:29,417 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:29,417 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,417 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:29,420 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,420 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:29,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,420 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:29,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:29,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,423 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:29,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:29,427 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:29,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:29,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:29,429 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:29,429 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:29,529 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:29,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:29,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:29,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:29,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,540 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:29,540 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,543 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:29,543 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:29,544 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:29,544 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:29,545 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:29,545 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:29,546 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:29,546 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:29,546 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:29,546 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:29,546 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:29,546 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:29,567 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e079452322c4457e85645799522d8656 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e079452322c4457e85645799522d8656 2023-11-22 10:53:29,771 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-22 10:53:29,772 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-22 10:53:29,983 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/0430c378c0724754b0df09cc38fed08e 2023-11-22 10:53:29,994 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/0430c378c0724754b0df09cc38fed08e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e 2023-11-22 10:53:30,004 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e, entries=1, sequenceid=25, filesize=5.0 K 2023-11-22 10:53:30,005 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 459ms, sequenceid=25, compaction requested=true 2023-11-22 10:53:30,005 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:30,006 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:30,006 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:30,006 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:30,006 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,006 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:30,006 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:30,009 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,009 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,009 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,009 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:30,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:30,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@169f1bd5[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:30,018 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:30,018 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,020 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:30,020 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,020 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:30,022 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,022 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:30,022 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,022 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:30,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:30,026 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:30,027 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:30,027 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:30,027 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,027 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:30,029 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,029 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:30,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,029 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,030 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,035 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,038 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:30,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:30,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,039 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,039 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,040 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:30,040 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:30,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:30,140 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:30,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:30,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:30,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:30,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,152 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:30,152 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:30,152 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:30,152 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:30,153 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,153 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,154 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:30,154 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,155 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,155 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:30,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:30,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:30,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:30,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:30,158 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:30,158 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:30,158 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:30,158 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:30,579 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dab098db57434fc9a917b12f2ac983bc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab098db57434fc9a917b12f2ac983bc 2023-11-22 10:53:30,590 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/5f35c85452884015a878446518cd8188 2023-11-22 10:53:30,597 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/5f35c85452884015a878446518cd8188 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188 2023-11-22 10:53:30,605 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188, entries=1, sequenceid=29, filesize=5.0 K 2023-11-22 10:53:30,606 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 448ms, sequenceid=29, compaction requested=true 2023-11-22 10:53:30,606 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:30,606 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:30,613 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,614 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,614 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:30,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:30,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@596b9ce6[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:30,617 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:30,617 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,619 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:30,619 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,619 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:30,621 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:30,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:30,626 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:30,626 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:30,626 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:30,626 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,626 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:30,629 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,629 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,629 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:30,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:30,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:30,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:30,635 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:30,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:30,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:30,635 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:30,635 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,635 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:30,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:30,636 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:30,636 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:30,736 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:30,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:30,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,747 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:30,747 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:30,748 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:30,748 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:30,748 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,748 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,750 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:30,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:30,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:30,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:30,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:30,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:30,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,752 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:30,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:30,752 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:30,752 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:30,752 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:30,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:30,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:30,753 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:30,753 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:30,753 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:30,805 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010394d6a2f7d3d44859ba8d3b4dda605e9c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010394d6a2f7d3d44859ba8d3b4dda605e9c 2023-11-22 10:53:31,215 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/3fbeec079e0c4854b8f3d0377f3da658 2023-11-22 10:53:31,225 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/3fbeec079e0c4854b8f3d0377f3da658 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658 2023-11-22 10:53:31,232 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658, entries=1, sequenceid=33, filesize=5.0 K 2023-11-22 10:53:31,233 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 480ms, sequenceid=33, compaction requested=true 2023-11-22 10:53:31,233 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:31,234 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:31,234 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:31,234 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:31,234 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,234 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:31,234 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:31,237 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,237 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:31,237 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,237 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:31,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:31,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e15fc6d[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:31,239 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:31,239 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,242 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:31,242 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,242 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:31,244 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,244 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:31,244 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:31,244 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:31,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:31,248 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:31,248 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:31,248 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:31,248 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,248 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:31,250 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,250 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,250 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:31,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:31,251 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,253 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,256 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:31,256 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:31,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:31,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:31,256 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:31,256 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:31,256 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,257 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,257 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,257 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:31,257 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:31,258 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,258 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:31,258 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,358 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:31,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:31,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:31,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:31,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,369 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:31,369 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:31,369 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:31,369 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:31,370 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,370 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,373 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,373 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:31,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:31,373 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:31,373 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,375 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:31,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:31,376 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:31,376 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:31,377 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:31,796 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078ea6f398626440f88e51a24bb289c0e0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509078ea6f398626440f88e51a24bb289c0e0 2023-11-22 10:53:32,205 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/7dec1f196a8f4dea902d45bda23b2b84 2023-11-22 10:53:32,215 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/7dec1f196a8f4dea902d45bda23b2b84 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84 2023-11-22 10:53:32,221 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84, entries=1, sequenceid=37, filesize=5.0 K 2023-11-22 10:53:32,223 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 846ms, sequenceid=37, compaction requested=true 2023-11-22 10:53:32,223 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:32,223 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:32,225 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,225 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:32,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:32,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:32,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32ea9a9[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:32,228 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:32,228 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,229 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,229 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:32,229 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:32,229 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:32,230 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,230 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:32,231 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:32,231 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,231 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:32,232 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:32,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:32,236 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:32,236 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:32,236 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:32,236 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,236 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:32,239 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,239 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:32,239 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:32,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:32,240 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,242 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:32,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:32,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:32,248 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,248 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:32,248 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:32,248 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,249 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:32,249 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:32,349 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:32,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:32,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:32,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:32,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,360 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:32,360 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:32,360 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-22 10:53:32,360 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-22 10:53:32,361 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,361 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,363 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:32,363 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:32,363 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:32,363 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-22 10:53:32,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:32,364 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-22 10:53:32,364 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-22 10:53:32,366 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:32,366 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:32,366 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:32,366 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. started... 2023-11-22 10:53:32,366 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ad6a67058299bbff56bafe728260442 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:32,789 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112088a6b38757bc405394c26000fdf490c4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112088a6b38757bc405394c26000fdf490c4 2023-11-22 10:53:33,210 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/a3be0e8f80ad47529feb48837802e635 2023-11-22 10:53:33,218 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/a3be0e8f80ad47529feb48837802e635 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635 2023-11-22 10:53:33,224 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635, entries=1, sequenceid=41, filesize=5.0 K 2023-11-22 10:53:33,225 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0ad6a67058299bbff56bafe728260442 in 859ms, sequenceid=41, compaction requested=true 2023-11-22 10:53:33,225 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:33,225 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-22 10:53:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-22 10:53:33,228 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,228 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:33,229 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,229 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:33,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-22 10:53:33,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d814baa[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:33,230 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-22 10:53:33,230 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,233 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,233 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-22 10:53:33,233 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-22 10:53:33,233 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:33,233 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,233 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-22 10:53:33,235 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-22 10:53:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:33,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-22 10:53:33,239 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-22 10:53:33,239 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:33,239 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:33,239 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,239 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:33,241 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,241 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:33,241 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:33,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:33,242 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,244 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:33,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-22 10:53:33,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:33,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-22 10:53:33,247 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,247 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:33,248 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:33,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:33,348 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:33,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:33,354 DEBUG [Listener at localhost/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-22 10:53:33,357 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-22 10:53:33,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:33,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:33,371 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:33,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:33,372 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651013372 2023-11-22 10:53:33,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:53:33,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-22 10:53:33,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x586dde8d to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:33,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@224d335, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:33,388 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,454 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103370e5ca8c3914783afbd350da204a169 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103370e5ca8c3914783afbd350da204a169 2023-11-22 10:53:33,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,474 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:33,476 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:33,486 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:53:33,488 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:53:33,526 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/37e8ac24906b4a06b3b6e11becc12508 first=Optional[r3] last=Optional[r6] 2023-11-22 10:53:33,542 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/37e8ac24906b4a06b3b6e11becc12508}] 2023-11-22 10:53:33,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/37e8ac24906b4a06b3b6e11becc12508 for inclusion in 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:33,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-22 10:53:33,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:33,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:33,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/37e8ac24906b4a06b3b6e11becc12508 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qhgdrpj82qpbc3v2k3v7uvdamk8983u6nl8brv0kh3fkqgi8vg1be282hurhcoef/family1/37e8ac24906b4a06b3b6e11becc12508 2023-11-22 10:53:33,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qhgdrpj82qpbc3v2k3v7uvdamk8983u6nl8brv0kh3fkqgi8vg1be282hurhcoef/family1/37e8ac24906b4a06b3b6e11becc12508 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_ 2023-11-22 10:53:33,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qhgdrpj82qpbc3v2k3v7uvdamk8983u6nl8brv0kh3fkqgi8vg1be282hurhcoef/family1/37e8ac24906b4a06b3b6e11becc12508 into 0ad6a67058299bbff56bafe728260442/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_ - updating store file list. 2023-11-22 10:53:33,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_ into 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:33,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qhgdrpj82qpbc3v2k3v7uvdamk8983u6nl8brv0kh3fkqgi8vg1be282hurhcoef/family1/37e8ac24906b4a06b3b6e11becc12508 into 0ad6a67058299bbff56bafe728260442/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_) 2023-11-22 10:53:33,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qhgdrpj82qpbc3v2k3v7uvdamk8983u6nl8brv0kh3fkqgi8vg1be282hurhcoef/family1/37e8ac24906b4a06b3b6e11becc12508 2023-11-22 10:53:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:53:33,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:53:33,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 0ad6a67058299bbff56bafe728260442/family1 is initiating minor compaction 2023-11-22 10:53:33,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@63ab87b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:33,601 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ad6a67058299bbff56bafe728260442/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:33,602 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp, totalSize=50.2 K 2023-11-22 10:53:33,603 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 21ced1f177844bff888a2c6e1a66b23b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:53:33,603 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 340c5d39127b4b96805308fa81f6ac5b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:53:33,603 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 596b29a1877b4203a5bf1d8fcfcc9a44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting abfd869ee1854934a469ffd5e5082865, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 0430c378c0724754b0df09cc38fed08e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5f35c85452884015a878446518cd8188, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 3fbeec079e0c4854b8f3d0377f3da658, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 7dec1f196a8f4dea902d45bda23b2b84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting a3be0e8f80ad47529feb48837802e635, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:53:33,604 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 1737a872413f4e49b4d634e30f6aed53_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:53:33,619 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,621 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:33,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228061623ed0a9547afa6f7060a1bd8170c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228061623ed0a9547afa6f7060a1bd8170c 2023-11-22 10:53:33,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e079452322c4457e85645799522d8656 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e079452322c4457e85645799522d8656 2023-11-22 10:53:33,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab098db57434fc9a917b12f2ac983bc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab098db57434fc9a917b12f2ac983bc 2023-11-22 10:53:33,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010394d6a2f7d3d44859ba8d3b4dda605e9c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010394d6a2f7d3d44859ba8d3b4dda605e9c 2023-11-22 10:53:33,645 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-22 10:53:33,645 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-22 10:53:33,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,685 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0ad6a67058299bbff56bafe728260442#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:53:33,804 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b7d25da702774b0a8b5a121dec3b7c06 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b7d25da702774b0a8b5a121dec3b7c06 2023-11-22 10:53:33,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,852 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/76e5a6ddc4c54693ac581bfeebeee9fc first=Optional[r00] last=Optional[r2] 2023-11-22 10:53:33,853 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/76e5a6ddc4c54693ac581bfeebeee9fc}] 2023-11-22 10:53:33,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/76e5a6ddc4c54693ac581bfeebeee9fc for inclusion in 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-22 10:53:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/76e5a6ddc4c54693ac581bfeebeee9fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__24hlamkf7tjf5oms52bocpktgq8csbcdhkoqbfeu76duch0solattu5loppi3h69/family1/76e5a6ddc4c54693ac581bfeebeee9fc 2023-11-22 10:53:33,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__24hlamkf7tjf5oms52bocpktgq8csbcdhkoqbfeu76duch0solattu5loppi3h69/family1/76e5a6ddc4c54693ac581bfeebeee9fc as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ 2023-11-22 10:53:33,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__24hlamkf7tjf5oms52bocpktgq8csbcdhkoqbfeu76duch0solattu5loppi3h69/family1/76e5a6ddc4c54693ac581bfeebeee9fc into 0ad6a67058299bbff56bafe728260442/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ - updating store file list. 2023-11-22 10:53:33,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ into 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:33,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__24hlamkf7tjf5oms52bocpktgq8csbcdhkoqbfeu76duch0solattu5loppi3h69/family1/76e5a6ddc4c54693ac581bfeebeee9fc into 0ad6a67058299bbff56bafe728260442/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_) 2023-11-22 10:53:33,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__24hlamkf7tjf5oms52bocpktgq8csbcdhkoqbfeu76duch0solattu5loppi3h69/family1/76e5a6ddc4c54693ac581bfeebeee9fc 2023-11-22 10:53:33,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:33,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130793b90523c4546f9804675bbfe4f95f5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130793b90523c4546f9804675bbfe4f95f5 2023-11-22 10:53:33,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201072118d762a24960a6174e5dd5cd19e3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201072118d762a24960a6174e5dd5cd19e3 2023-11-22 10:53:33,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509bba6d3c592467da7fb1afc87713c4d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509bba6d3c592467da7fb1afc87713c4d 2023-11-22 10:53:33,884 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-22 10:53:33,884 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-22 10:53:33,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:33,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:33,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:33,886 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:33,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 523 msec 2023-11-22 10:53:34,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-22 10:53:34,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:34,485 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-22 10:53:34,487 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:34,487 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-22 10:53:34,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-22 10:53:34,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, REOPEN/MOVE}] 2023-11-22 10:53:34,505 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, REOPEN/MOVE 2023-11-22 10:53:34,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:34,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650414505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650414505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650414505"}]},"ts":"1700650414505"} 2023-11-22 10:53:34,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:34,524 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/1fe0493dbd3343598a0f926a9b6212ad as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad 2023-11-22 10:53:34,539 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0ad6a67058299bbff56bafe728260442/family1 of 0ad6a67058299bbff56bafe728260442 into 1fe0493dbd3343598a0f926a9b6212ad(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:53:34,539 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:34,541 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700650413599; duration=0sec 2023-11-22 10:53:34,543 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:34,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_] to archive 2023-11-22 10:53:34,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:34,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/21ced1f177844bff888a2c6e1a66b23b 2023-11-22 10:53:34,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/340c5d39127b4b96805308fa81f6ac5b 2023-11-22 10:53:34,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/596b29a1877b4203a5bf1d8fcfcc9a44 2023-11-22 10:53:34,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/abfd869ee1854934a469ffd5e5082865 2023-11-22 10:53:34,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/0430c378c0724754b0df09cc38fed08e 2023-11-22 10:53:34,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/5f35c85452884015a878446518cd8188 2023-11-22 10:53:34,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/3fbeec079e0c4854b8f3d0377f3da658 2023-11-22 10:53:34,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/7dec1f196a8f4dea902d45bda23b2b84 2023-11-22 10:53:34,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/a3be0e8f80ad47529feb48837802e635 2023-11-22 10:53:34,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1737a872413f4e49b4d634e30f6aed53_SeqId_44_ 2023-11-22 10:53:34,664 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:34,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:34,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ad6a67058299bbff56bafe728260442, disabling compactions & flushes 2023-11-22 10:53:34,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:34,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:34,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. after waiting 0 ms 2023-11-22 10:53:34,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:34,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-22 10:53:34,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:34,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:34,677 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0ad6a67058299bbff56bafe728260442 to self. 2023-11-22 10:53:34,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:34,679 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=CLOSED 2023-11-22 10:53:34,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650414679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650414679"}]},"ts":"1700650414679"} 2023-11-22 10:53:34,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=16, resume processing ppid=15 2023-11-22 10:53:34,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831 in 174 msec 2023-11-22 10:53:34,685 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=true 2023-11-22 10:53:34,836 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:34,836 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650414835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650414835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650414835"}]},"ts":"1700650414835"} 2023-11-22 10:53:34,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:34,991 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:34,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:34,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ad6a67058299bbff56bafe728260442, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:34,999 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:35,001 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:35,001 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:35,001 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ad6a67058299bbff56bafe728260442 columnFamilyName family1 2023-11-22 10:53:35,014 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad 2023-11-22 10:53:35,029 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089 2023-11-22 10:53:35,035 DEBUG [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ 2023-11-22 10:53:35,036 INFO [StoreOpener-0ad6a67058299bbff56bafe728260442-1] regionserver.HStore(310): Store=0ad6a67058299bbff56bafe728260442/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:35,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:35,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:53:35,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ad6a67058299bbff56bafe728260442; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68477367, jitterRate=0.0203922837972641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:35,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:35,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., pid=17, masterSystemTime=1700650414991 2023-11-22 10:53:35,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:35,047 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:53:35,049 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:53:35,049 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1912): 0ad6a67058299bbff56bafe728260442/family1 is initiating minor compaction (all files) 2023-11-22 10:53:35,049 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ad6a67058299bbff56bafe728260442/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:35,049 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp, totalSize=358.6 K 2023-11-22 10:53:35,050 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 22b8b9f4196348a2bcd25baa29efb089, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:53:35,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:35,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:53:35,051 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 1fe0493dbd3343598a0f926a9b6212ad, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:53:35,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ad6a67058299bbff56bafe728260442, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:35,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700650415051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650415051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650415051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650415051"}]},"ts":"1700650415051"} 2023-11-22 10:53:35,052 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878824734 2023-11-22 10:53:35,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=17, resume processing ppid=15 2023-11-22 10:53:35,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 0ad6a67058299bbff56bafe728260442, server=jenkins-hbase4.apache.org,46051,1700650400831 in 217 msec 2023-11-22 10:53:35,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=15, resume processing ppid=14 2023-11-22 10:53:35,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0ad6a67058299bbff56bafe728260442, REOPEN/MOVE in 556 msec 2023-11-22 10:53:35,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=14, resume processing ppid=13 2023-11-22 10:53:35,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 574 msec 2023-11-22 10:53:35,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0050 sec 2023-11-22 10:53:35,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-22 10:53:35,085 INFO [Listener at localhost/45227] compactions.TestMobCompactor(278): alter status finished 2023-11-22 10:53:35,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-22 10:53:35,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:35,090 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:35,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:35,091 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651015091 2023-11-22 10:53:35,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:53:35,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-22 10:53:35,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:35,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x7f21c565 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:35,106 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0ad6a67058299bbff56bafe728260442#family1#compaction#11 average throughput is 5.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:53:35,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19d7bd75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:35,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,551 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/.tmp/family1/ce4716d783bb4c1b9928cc567bbc8189 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/ce4716d783bb4c1b9928cc567bbc8189 2023-11-22 10:53:35,557 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0ad6a67058299bbff56bafe728260442/family1 of 0ad6a67058299bbff56bafe728260442 into ce4716d783bb4c1b9928cc567bbc8189(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:53:35,557 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:35,558 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., storeName=0ad6a67058299bbff56bafe728260442/family1, priority=13, startTime=1700650415046; duration=0sec 2023-11-22 10:53:35,558 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:35,562 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d91aece2df5444caa4235da7bf73c0c2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d91aece2df5444caa4235da7bf73c0c2 2023-11-22 10:53:35,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:35,577 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:35,578 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:35,587 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:53:35,588 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:53:35,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d4da3fcf8e0e457baea05567a0c6ed9b first=Optional[r05] last=Optional[r8] 2023-11-22 10:53:35,602 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=50 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d4da3fcf8e0e457baea05567a0c6ed9b}] 2023-11-22 10:53:35,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d4da3fcf8e0e457baea05567a0c6ed9b for inclusion in 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:35,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-22 10:53:35,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:35,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:53:35,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d4da3fcf8e0e457baea05567a0c6ed9b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t69hrmr8ms2urb39pqkk465ru7tqh9t2771shuqij2lev8kbchnrgjf8ns2g706l/family1/d4da3fcf8e0e457baea05567a0c6ed9b 2023-11-22 10:53:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t69hrmr8ms2urb39pqkk465ru7tqh9t2771shuqij2lev8kbchnrgjf8ns2g706l/family1/d4da3fcf8e0e457baea05567a0c6ed9b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/e58e276285944e92b3d2652736503a2f_SeqId_53_ 2023-11-22 10:53:35,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t69hrmr8ms2urb39pqkk465ru7tqh9t2771shuqij2lev8kbchnrgjf8ns2g706l/family1/d4da3fcf8e0e457baea05567a0c6ed9b into 0ad6a67058299bbff56bafe728260442/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/e58e276285944e92b3d2652736503a2f_SeqId_53_ - updating store file list. 2023-11-22 10:53:35,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/e58e276285944e92b3d2652736503a2f_SeqId_53_ into 0ad6a67058299bbff56bafe728260442/family1 2023-11-22 10:53:35,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t69hrmr8ms2urb39pqkk465ru7tqh9t2771shuqij2lev8kbchnrgjf8ns2g706l/family1/d4da3fcf8e0e457baea05567a0c6ed9b into 0ad6a67058299bbff56bafe728260442/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/e58e276285944e92b3d2652736503a2f_SeqId_53_) 2023-11-22 10:53:35,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t69hrmr8ms2urb39pqkk465ru7tqh9t2771shuqij2lev8kbchnrgjf8ns2g706l/family1/d4da3fcf8e0e457baea05567a0c6ed9b 2023-11-22 10:53:35,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:35,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:35,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112088a6b38757bc405394c26000fdf490c4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112088a6b38757bc405394c26000fdf490c4 2023-11-22 10:53:35,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128860b4f7aa797473681f35ef128f79583 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128860b4f7aa797473681f35ef128f79583 2023-11-22 10:53:35,632 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-22 10:53:35,632 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-22 10:53:35,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-22 10:53:35,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-22 10:53:35,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:35,634 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-22 10:53:35,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 546 msec 2023-11-22 10:53:35,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_] to archive 2023-11-22 10:53:35,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:35,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/22b8b9f4196348a2bcd25baa29efb089 2023-11-22 10:53:35,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/1fe0493dbd3343598a0f926a9b6212ad 2023-11-22 10:53:35,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/family1/78eca38d30de4d93b0a11d17cf2ec20d_SeqId_46_ 2023-11-22 10:53:35,774 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 213) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34232 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-93071633_17 at /127.0.0.1:58940 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58752 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58966 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58800 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58910 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58824 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58996 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58994 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x586dde8d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x236ac6b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58930 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58790 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x236ac6b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x7f21c565-SendThread(127.0.0.1:57046) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x586dde8d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1529460914.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58774 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x236ac6b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:46051-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x7f21c565-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58902 [Waiting for operation #38] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34254 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x586dde8d-SendThread(127.0.0.1:57046) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x7f21c565 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1529460914.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:58968 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=624 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=336 (was 370), ProcessCount=171 (was 171), AvailableMemoryMB=9986 (was 10315) 2023-11-22 10:53:35,793 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=336, ProcessCount=171, AvailableMemoryMB=9983 2023-11-22 10:53:35,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-22 10:53:35,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:35,812 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:53:35,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-22 10:53:35,814 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:53:35,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:35,816 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:35,817 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096 empty. 2023-11-22 10:53:35,818 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:35,818 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-22 10:53:35,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:36,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:36,230 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:36,232 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d1127a5b857997a0630bd4d22b05e096, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:53:36,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:36,639 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:36,639 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing d1127a5b857997a0630bd4d22b05e096, disabling compactions & flushes 2023-11-22 10:53:36,639 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,639 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,639 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. after waiting 0 ms 2023-11-22 10:53:36,639 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,640 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,640 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:36,643 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:53:36,644 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650416644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650416644"}]},"ts":"1700650416644"} 2023-11-22 10:53:36,647 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:53:36,648 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:53:36,648 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650416648"}]},"ts":"1700650416648"} 2023-11-22 10:53:36,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-22 10:53:36,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=d1127a5b857997a0630bd4d22b05e096, ASSIGN}] 2023-11-22 10:53:36,658 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=d1127a5b857997a0630bd4d22b05e096, ASSIGN 2023-11-22 10:53:36,659 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=d1127a5b857997a0630bd4d22b05e096, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:53:36,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d1127a5b857997a0630bd4d22b05e096, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:36,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650416810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650416810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650416810"}]},"ts":"1700650416810"} 2023-11-22 10:53:36,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure d1127a5b857997a0630bd4d22b05e096, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:36,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:36,965 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:36,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1127a5b857997a0630bd4d22b05e096, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:36,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:36,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,971 INFO [StoreOpener-d1127a5b857997a0630bd4d22b05e096-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,973 DEBUG [StoreOpener-d1127a5b857997a0630bd4d22b05e096-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:36,973 DEBUG [StoreOpener-d1127a5b857997a0630bd4d22b05e096-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:36,973 INFO [StoreOpener-d1127a5b857997a0630bd4d22b05e096-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1127a5b857997a0630bd4d22b05e096 columnFamilyName family1 2023-11-22 10:53:36,975 INFO [StoreOpener-d1127a5b857997a0630bd4d22b05e096-1] regionserver.HStore(310): Store=d1127a5b857997a0630bd4d22b05e096/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:36,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:53:36,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:36,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1127a5b857997a0630bd4d22b05e096; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71774901, jitterRate=0.06952936947345734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:36,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:36,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., pid=21, masterSystemTime=1700650416965 2023-11-22 10:53:36,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:36,987 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d1127a5b857997a0630bd4d22b05e096, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:36,987 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650416987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650416987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650416987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650416987"}]},"ts":"1700650416987"} 2023-11-22 10:53:36,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=21, resume processing ppid=20 2023-11-22 10:53:36,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure d1127a5b857997a0630bd4d22b05e096, server=jenkins-hbase4.apache.org,46051,1700650400831 in 176 msec 2023-11-22 10:53:36,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=20, resume processing ppid=19 2023-11-22 10:53:36,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=d1127a5b857997a0630bd4d22b05e096, ASSIGN in 336 msec 2023-11-22 10:53:36,994 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:53:36,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650416994"}]},"ts":"1700650416994"} 2023-11-22 10:53:36,996 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-22 10:53:36,998 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:53:37,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2020 sec 2023-11-22 10:53:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-22 10:53:37,922 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-22 10:53:37,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:37,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,956 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:37,956 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:37,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:37,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:37,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,959 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:37,959 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:37,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:37,959 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:37,959 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,960 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:37,960 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:37,961 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:37,961 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:37,962 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:53:38,385 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a3b0ecd292be4d52ad2aba85eb3c9fb3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a3b0ecd292be4d52ad2aba85eb3c9fb3 2023-11-22 10:53:38,790 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/2aa6561634d948b780949618a4130cf2 2023-11-22 10:53:38,796 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/2aa6561634d948b780949618a4130cf2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2 2023-11-22 10:53:38,802 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-22 10:53:38,803 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 841ms, sequenceid=5, compaction requested=false 2023-11-22 10:53:38,803 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:38,804 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:38,804 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:38,870 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:38,871 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,871 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:38,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:38,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68886650[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:38,873 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:38,873 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,901 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,901 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:38,901 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:38,901 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:38,901 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,901 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:38,950 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,950 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:38,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:38,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:38,950 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:38,950 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:38,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:38,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:38,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:38,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:38,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:38,954 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:38,954 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:38,954 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:38,954 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,954 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:38,986 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,986 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,986 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:38,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:38,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:38,987 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:38,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:39,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:39,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:39,194 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:39,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,195 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,195 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:39,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:39,195 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:39,295 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:39,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:39,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:39,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:39,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,306 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:39,306 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:39,306 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:39,307 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:39,307 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,307 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,401 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:39,402 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:39,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:39,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:39,402 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:39,402 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:39,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:39,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:39,403 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:39,403 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:39,404 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:39,404 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:39,404 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:39,404 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:39,404 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:39,404 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:53:39,820 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281b47a58bdd924864afb0871546486914 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281b47a58bdd924864afb0871546486914 2023-11-22 10:53:40,211 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:53:40,227 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/f7a13d16abf2411e899a59eb97fbe5ff 2023-11-22 10:53:40,236 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/f7a13d16abf2411e899a59eb97fbe5ff as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff 2023-11-22 10:53:40,250 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:53:40,251 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 847ms, sequenceid=9, compaction requested=false 2023-11-22 10:53:40,252 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:40,252 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:40,252 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:40,325 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:40,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:40,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29bf19b8[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:40,327 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:40,327 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,387 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:40,387 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:40,387 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:40,387 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,387 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:40,440 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:40,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:40,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:40,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:40,446 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:40,446 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:40,446 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:40,446 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,446 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:40,517 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,517 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:40,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,520 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,521 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,523 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:40,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,586 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:40,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:40,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:40,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:40,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,587 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:40,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:40,588 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:40,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:53:40,688 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:40,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:40,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:40,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:40,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,698 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:40,698 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:40,699 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:40,699 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:40,699 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,699 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,763 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,763 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:40,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:40,764 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:40,764 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:40,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:40,766 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:40,766 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:40,766 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:40,766 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:41,182 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016a5f74a2d8f8442da58b84b184c88ed6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016a5f74a2d8f8442da58b84b184c88ed6 2023-11-22 10:53:41,588 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/8c06475d43db4c99b6dbc50c520c4227 2023-11-22 10:53:41,595 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/8c06475d43db4c99b6dbc50c520c4227 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227 2023-11-22 10:53:41,601 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227, entries=1, sequenceid=13, filesize=4.9 K 2023-11-22 10:53:41,602 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 836ms, sequenceid=13, compaction requested=true 2023-11-22 10:53:41,602 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:41,602 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:41,647 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:41,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:41,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f2a9ec7[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:41,650 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:41,650 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:41,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:41,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:41,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:41,755 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:41,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:41,759 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:41,759 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:41,759 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:41,759 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,759 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:41,810 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,810 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,810 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:41,810 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,812 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,870 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,871 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:41,871 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:41,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:41,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:53:41,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:41,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:41,871 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,871 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:41,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:41,972 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:41,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:41,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:41,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,981 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:41,981 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:41,982 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:41,982 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:41,982 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:41,982 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,024 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:42,024 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:42,025 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,025 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:42,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:42,027 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:42,027 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:42,027 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:42,442 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205418c90d46554445194c434e386b6b51d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205418c90d46554445194c434e386b6b51d 2023-11-22 10:53:42,848 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/cb6799b6fdc84478a9e1c31af00c14db 2023-11-22 10:53:42,854 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/cb6799b6fdc84478a9e1c31af00c14db as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db 2023-11-22 10:53:42,859 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db, entries=1, sequenceid=17, filesize=4.9 K 2023-11-22 10:53:42,860 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 833ms, sequenceid=17, compaction requested=true 2023-11-22 10:53:42,861 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:42,861 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:42,901 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:42,902 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,902 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:42,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:42,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38914293[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:42,903 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:42,903 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:42,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:42,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:42,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:42,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:42,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:43,155 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:43,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:43,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:43,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:43,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:43,159 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:43,159 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:43,159 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:43,159 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,159 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:43,224 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,224 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:43,224 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:43,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:43,225 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:43,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,227 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:43,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:43,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:43,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:43,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:43,309 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:43,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,310 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,310 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,310 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,310 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,310 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,311 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:43,311 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:43,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:43,411 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:43,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:43,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,420 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:43,420 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:43,422 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,422 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,455 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,455 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:43,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:43,455 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:43,455 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:43,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,456 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:43,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:43,457 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:43,457 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:43,457 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:43,457 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:43,457 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:43,457 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:43,457 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:43,875 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e2921cee786348d0bfddf883fff5e0cf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2921cee786348d0bfddf883fff5e0cf 2023-11-22 10:53:44,281 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/918689b95adf4f789d29428da5228123 2023-11-22 10:53:44,288 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/918689b95adf4f789d29428da5228123 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123 2023-11-22 10:53:44,294 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123, entries=1, sequenceid=21, filesize=4.9 K 2023-11-22 10:53:44,295 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 838ms, sequenceid=21, compaction requested=true 2023-11-22 10:53:44,295 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:44,295 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:44,295 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:44,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,297 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:44,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13800937[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:44,300 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:44,300 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,302 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:44,302 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,302 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:44,304 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:44,308 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:44,308 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:44,308 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:44,308 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,308 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:44,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,309 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,310 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,312 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,314 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,314 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:44,315 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:44,316 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:44,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:53:44,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:44,316 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:44,317 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:44,317 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:44,417 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:44,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:44,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:44,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:44,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,426 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:44,426 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:44,427 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:44,427 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:44,428 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,428 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,430 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,430 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:44,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:44,431 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,431 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:44,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,432 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:44,432 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:44,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:44,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:44,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:44,433 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:44,433 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:44,433 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:44,849 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123124fe7e850dcd47e19ea730221848731d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123124fe7e850dcd47e19ea730221848731d 2023-11-22 10:53:44,856 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/2507189b69054f03927ab4c77a292f22 2023-11-22 10:53:44,862 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/2507189b69054f03927ab4c77a292f22 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22 2023-11-22 10:53:44,868 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22, entries=1, sequenceid=25, filesize=4.9 K 2023-11-22 10:53:44,869 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 436ms, sequenceid=25, compaction requested=true 2023-11-22 10:53:44,869 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:44,869 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:44,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:44,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4223a026[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:44,875 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:44,875 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,876 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:44,877 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,877 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:44,878 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,878 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,878 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:44,879 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:44,884 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:44,884 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:44,884 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:44,884 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,884 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:44,887 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,887 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:44,887 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:44,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:44,888 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,890 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,893 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:44,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:44,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:44,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:44,893 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:44,894 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,894 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,894 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:44,894 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:44,895 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:44,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:44,995 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:45,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,003 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:45,003 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:45,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:45,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:45,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,005 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,006 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:45,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:45,006 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,006 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,007 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:45,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:45,008 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:45,008 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:45,009 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:45,426 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101db0ad9dba7054fc9acfcc0d18f90377d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0ad9dba7054fc9acfcc0d18f90377d 2023-11-22 10:53:45,435 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/09416417718b41be830ccc82994183b3 2023-11-22 10:53:45,441 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/09416417718b41be830ccc82994183b3 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3 2023-11-22 10:53:45,447 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3, entries=1, sequenceid=29, filesize=4.9 K 2023-11-22 10:53:45,449 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 440ms, sequenceid=29, compaction requested=true 2023-11-22 10:53:45,449 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:45,449 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:45,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,461 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:45,461 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,461 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:45,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:45,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4974c203[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:45,463 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:45,463 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,464 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:45,465 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,465 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:45,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:45,467 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:45,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:45,471 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:45,471 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:45,471 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:45,471 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,471 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:45,473 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,473 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:45,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,473 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:45,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:45,473 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,475 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:45,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,480 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:45,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:45,480 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,480 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:45,480 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:45,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:53:45,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:45,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:45,480 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:45,481 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:45,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:45,581 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:45,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:45,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:45,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:45,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,592 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:45,592 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:45,593 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:45,593 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:45,593 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,593 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,596 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,596 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:45,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:45,596 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:45,596 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,597 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:45,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:45,597 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:45,597 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:45,598 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:45,598 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:45,598 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:46,015 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031a5d87703a57427495b9704ecd2df1f8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a5d87703a57427495b9704ecd2df1f8 2023-11-22 10:53:46,422 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/6248f31a1c5e453095d1a5740fe16fcb 2023-11-22 10:53:46,429 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/6248f31a1c5e453095d1a5740fe16fcb as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb 2023-11-22 10:53:46,435 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb, entries=1, sequenceid=33, filesize=4.9 K 2023-11-22 10:53:46,436 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 838ms, sequenceid=33, compaction requested=true 2023-11-22 10:53:46,437 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:46,437 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:46,437 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:46,437 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:46,437 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,437 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:46,437 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:46,439 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,439 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:46,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:46,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:46,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bc39464[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:46,441 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:46,442 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:46,445 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,445 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:46,446 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,446 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:46,446 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:46,446 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:46,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:46,450 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:46,450 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:46,450 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:46,450 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,450 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:46,453 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,453 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:46,453 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:46,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:46,454 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,457 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,460 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:46,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:46,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:46,461 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:46,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:46,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:46,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,462 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:46,463 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:46,563 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:46,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:46,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:46,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:46,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,572 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:46,572 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:46,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:46,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:46,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,575 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:46,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:46,575 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:46,575 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:46,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:46,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:46,577 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:46,577 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:46,577 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:46,577 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:46,577 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:46,994 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907123a90370e3e468cb3eca3c9bac2df37 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907123a90370e3e468cb3eca3c9bac2df37 2023-11-22 10:53:47,400 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/5bd245e99f524fec8b66c5c7d69cdd66 2023-11-22 10:53:47,407 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/5bd245e99f524fec8b66c5c7d69cdd66 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66 2023-11-22 10:53:47,415 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66, entries=1, sequenceid=37, filesize=4.9 K 2023-11-22 10:53:47,416 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 839ms, sequenceid=37, compaction requested=true 2023-11-22 10:53:47,416 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:47,416 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:47,419 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:47,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:47,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6819e39a[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,422 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:47,423 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,423 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:47,424 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:47,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:47,429 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:47,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:47,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:47,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,429 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:47,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:47,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:47,433 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,439 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,446 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,446 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:47,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:47,447 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:47,447 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,448 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:47,448 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:47,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:47,548 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:47,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:47,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:47,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:47,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,557 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:47,557 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:47,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:53:47,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:47,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,560 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,560 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:47,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:47,560 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:47,560 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,561 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,561 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:53:47,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:47,562 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:53:47,562 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:47,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:53:47,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:47,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:47,563 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:47,563 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. started... 2023-11-22 10:53:47,563 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1127a5b857997a0630bd4d22b05e096 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:47,995 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208825ee49fd3f453388ba4704c0fd5aa1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208825ee49fd3f453388ba4704c0fd5aa1 2023-11-22 10:53:48,412 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/56ca6d708ed942108303a545c4cb7cbc 2023-11-22 10:53:48,418 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/56ca6d708ed942108303a545c4cb7cbc as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc 2023-11-22 10:53:48,423 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc, entries=1, sequenceid=41, filesize=4.9 K 2023-11-22 10:53:48,424 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1127a5b857997a0630bd4d22b05e096 in 861ms, sequenceid=41, compaction requested=true 2023-11-22 10:53:48,425 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:48,425 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:53:48,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,427 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:48,427 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,427 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:48,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:53:48,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37e45c2f[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:48,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:48,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,431 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,431 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:48,431 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:53:48,431 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,431 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:48,431 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:48,433 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:53:48,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:48,433 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:53:48,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:48,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:48,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:48,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:48,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:48,436 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:53:48,436 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:48,436 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:48,436 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,436 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:48,438 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,438 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:48,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:48,438 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:48,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:48,439 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,440 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,442 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,442 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,442 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:48,442 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:48,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:48,443 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:48,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:53:48,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-22 10:53:48,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:48,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:48,444 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:48,445 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:48,445 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:48,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:48,545 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:48,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:48,548 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-22 10:53:48,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:53:48,551 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:53:48,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:48,552 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651028552 2023-11-22 10:53:48,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:53:48,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-22 10:53:48,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:48,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x0971a43c to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:53:48,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e13048d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:53:48,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:49,413 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037132de3034f74705a1f296aff894a0bd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037132de3034f74705a1f296aff894a0bd 2023-11-22 10:53:49,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:49,428 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:53:49,430 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:53:49,436 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:53:49,437 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:53:49,447 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bd8f37cd1b0f4f409b6c4424eb9a429d first=Optional[r5] last=Optional[r6] 2023-11-22 10:53:49,447 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bd8f37cd1b0f4f409b6c4424eb9a429d}] 2023-11-22 10:53:49,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bd8f37cd1b0f4f409b6c4424eb9a429d for inclusion in d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:49,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-22 10:53:49,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:49,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:49,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/bd8f37cd1b0f4f409b6c4424eb9a429d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__epp6l49ug2bnal0vjs9vnrbca6hpssm5d3uafrm7m1o2374uf3kmp8covert8il2/family1/bd8f37cd1b0f4f409b6c4424eb9a429d 2023-11-22 10:53:49,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__epp6l49ug2bnal0vjs9vnrbca6hpssm5d3uafrm7m1o2374uf3kmp8covert8il2/family1/bd8f37cd1b0f4f409b6c4424eb9a429d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_ 2023-11-22 10:53:49,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__epp6l49ug2bnal0vjs9vnrbca6hpssm5d3uafrm7m1o2374uf3kmp8covert8il2/family1/bd8f37cd1b0f4f409b6c4424eb9a429d into d1127a5b857997a0630bd4d22b05e096/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_ - updating store file list. 2023-11-22 10:53:49,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_ into d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:49,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__epp6l49ug2bnal0vjs9vnrbca6hpssm5d3uafrm7m1o2374uf3kmp8covert8il2/family1/bd8f37cd1b0f4f409b6c4424eb9a429d into d1127a5b857997a0630bd4d22b05e096/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_) 2023-11-22 10:53:49,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__epp6l49ug2bnal0vjs9vnrbca6hpssm5d3uafrm7m1o2374uf3kmp8covert8il2/family1/bd8f37cd1b0f4f409b6c4424eb9a429d 2023-11-22 10:53:49,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:53:49,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:53:49,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): d1127a5b857997a0630bd4d22b05e096/family1 is initiating minor compaction 2023-11-22 10:53:49,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@71ed1610; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:49,468 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d1127a5b857997a0630bd4d22b05e096/family1 in testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:49,468 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp, totalSize=49.7 K 2023-11-22 10:53:49,468 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting f7a13d16abf2411e899a59eb97fbe5ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:53:49,468 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 8c06475d43db4c99b6dbc50c520c4227, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:53:49,468 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting cb6799b6fdc84478a9e1c31af00c14db, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 918689b95adf4f789d29428da5228123, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 2507189b69054f03927ab4c77a292f22, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 09416417718b41be830ccc82994183b3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 6248f31a1c5e453095d1a5740fe16fcb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5bd245e99f524fec8b66c5c7d69cdd66, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 56ca6d708ed942108303a545c4cb7cbc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:53:49,469 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:53:49,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:49,471 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:49,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0ad9dba7054fc9acfcc0d18f90377d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0ad9dba7054fc9acfcc0d18f90377d 2023-11-22 10:53:49,474 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a5d87703a57427495b9704ecd2df1f8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a5d87703a57427495b9704ecd2df1f8 2023-11-22 10:53:49,474 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-22 10:53:49,474 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-22 10:53:49,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:49,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:49,512 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1127a5b857997a0630bd4d22b05e096#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:53:49,933 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/7be91a21f1d9494aa5540bb87cc387eb as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/7be91a21f1d9494aa5540bb87cc387eb 2023-11-22 10:53:49,940 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d1127a5b857997a0630bd4d22b05e096/family1 of d1127a5b857997a0630bd4d22b05e096 into 7be91a21f1d9494aa5540bb87cc387eb(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:53:49,940 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:49,940 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700650429468; duration=0sec 2023-11-22 10:53:49,941 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:49,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_] to archive 2023-11-22 10:53:49,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:49,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/f7a13d16abf2411e899a59eb97fbe5ff 2023-11-22 10:53:49,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/8c06475d43db4c99b6dbc50c520c4227 2023-11-22 10:53:49,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/cb6799b6fdc84478a9e1c31af00c14db 2023-11-22 10:53:49,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/918689b95adf4f789d29428da5228123 2023-11-22 10:53:49,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2507189b69054f03927ab4c77a292f22 2023-11-22 10:53:49,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/09416417718b41be830ccc82994183b3 2023-11-22 10:53:49,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/6248f31a1c5e453095d1a5740fe16fcb 2023-11-22 10:53:49,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/5bd245e99f524fec8b66c5c7d69cdd66 2023-11-22 10:53:49,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/56ca6d708ed942108303a545c4cb7cbc 2023-11-22 10:53:49,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/0d1b4ad78f2d44feac70d411ed226a46_SeqId_44_ 2023-11-22 10:53:50,336 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313b504cea7d0544b2b6405ca9d45dad23 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313b504cea7d0544b2b6405ca9d45dad23 2023-11-22 10:53:50,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:50,361 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/89c51ed21db2460ea0963ac0355428dc first=Optional[r1] last=Optional[r4] 2023-11-22 10:53:50,362 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/89c51ed21db2460ea0963ac0355428dc}] 2023-11-22 10:53:50,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/89c51ed21db2460ea0963ac0355428dc for inclusion in d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:50,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-22 10:53:50,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:50,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:50,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/89c51ed21db2460ea0963ac0355428dc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rhm8ljj1uo7v0upqc5328eklmcbin0jggv8qi3nqr485r34a2va7rcmn1uv1t179/family1/89c51ed21db2460ea0963ac0355428dc 2023-11-22 10:53:50,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rhm8ljj1uo7v0upqc5328eklmcbin0jggv8qi3nqr485r34a2va7rcmn1uv1t179/family1/89c51ed21db2460ea0963ac0355428dc as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_ 2023-11-22 10:53:50,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rhm8ljj1uo7v0upqc5328eklmcbin0jggv8qi3nqr485r34a2va7rcmn1uv1t179/family1/89c51ed21db2460ea0963ac0355428dc into d1127a5b857997a0630bd4d22b05e096/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_ - updating store file list. 2023-11-22 10:53:50,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_ into d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:50,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rhm8ljj1uo7v0upqc5328eklmcbin0jggv8qi3nqr485r34a2va7rcmn1uv1t179/family1/89c51ed21db2460ea0963ac0355428dc into d1127a5b857997a0630bd4d22b05e096/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_) 2023-11-22 10:53:50,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rhm8ljj1uo7v0upqc5328eklmcbin0jggv8qi3nqr485r34a2va7rcmn1uv1t179/family1/89c51ed21db2460ea0963ac0355428dc 2023-11-22 10:53:50,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:53:50,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:53:50,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): d1127a5b857997a0630bd4d22b05e096/family1 is initiating minor compaction (all files) 2023-11-22 10:53:50,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2fb3be5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:50,381 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d1127a5b857997a0630bd4d22b05e096/family1 in testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:53:50,381 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/7be91a21f1d9494aa5540bb87cc387eb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp, totalSize=178.1 K 2023-11-22 10:53:50,382 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 2aa6561634d948b780949618a4130cf2, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:53:50,382 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 7be91a21f1d9494aa5540bb87cc387eb, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:53:50,383 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting a020c5be0b6f4fb89388406443cf249b_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224734 2023-11-22 10:53:50,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:50,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:50,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016a5f74a2d8f8442da58b84b184c88ed6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016a5f74a2d8f8442da58b84b184c88ed6 2023-11-22 10:53:50,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205418c90d46554445194c434e386b6b51d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205418c90d46554445194c434e386b6b51d 2023-11-22 10:53:50,390 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2921cee786348d0bfddf883fff5e0cf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2921cee786348d0bfddf883fff5e0cf 2023-11-22 10:53:50,392 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123124fe7e850dcd47e19ea730221848731d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123124fe7e850dcd47e19ea730221848731d 2023-11-22 10:53:50,392 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-22 10:53:50,392 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-22 10:53:50,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:50,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:50,414 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1127a5b857997a0630bd4d22b05e096#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:53:50,447 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113020ec5ad37a6d4ee590d897154ec77bca to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113020ec5ad37a6d4ee590d897154ec77bca 2023-11-22 10:53:50,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:50,454 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/.tmp/family1/26dd4c95ae114e8aac7c05f379996d0b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/26dd4c95ae114e8aac7c05f379996d0b 2023-11-22 10:53:50,461 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d1127a5b857997a0630bd4d22b05e096/family1 of d1127a5b857997a0630bd4d22b05e096 into 26dd4c95ae114e8aac7c05f379996d0b(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:53:50,461 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:50,461 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700650430381; duration=0sec 2023-11-22 10:53:50,461 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:53:50,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b018595756e4556b98cf92848e53c3f first=Optional[r00] last=Optional[r8] 2023-11-22 10:53:50,482 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b018595756e4556b98cf92848e53c3f}] 2023-11-22 10:53:50,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b018595756e4556b98cf92848e53c3f for inclusion in d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-22 10:53:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:53:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:53:50,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b018595756e4556b98cf92848e53c3f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ab46lh8qnsk7g9bf2ice9mqotqbrdo5c5kb5cssfinqhif0pjsasav376ub5g1kp/family1/6b018595756e4556b98cf92848e53c3f 2023-11-22 10:53:50,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ab46lh8qnsk7g9bf2ice9mqotqbrdo5c5kb5cssfinqhif0pjsasav376ub5g1kp/family1/6b018595756e4556b98cf92848e53c3f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/66d3aff93e0c4466b598c91d9902cded_SeqId_50_ 2023-11-22 10:53:50,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ab46lh8qnsk7g9bf2ice9mqotqbrdo5c5kb5cssfinqhif0pjsasav376ub5g1kp/family1/6b018595756e4556b98cf92848e53c3f into d1127a5b857997a0630bd4d22b05e096/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/66d3aff93e0c4466b598c91d9902cded_SeqId_50_ - updating store file list. 2023-11-22 10:53:50,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/66d3aff93e0c4466b598c91d9902cded_SeqId_50_ into d1127a5b857997a0630bd4d22b05e096/family1 2023-11-22 10:53:50,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ab46lh8qnsk7g9bf2ice9mqotqbrdo5c5kb5cssfinqhif0pjsasav376ub5g1kp/family1/6b018595756e4556b98cf92848e53c3f into d1127a5b857997a0630bd4d22b05e096/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/66d3aff93e0c4466b598c91d9902cded_SeqId_50_) 2023-11-22 10:53:50,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ab46lh8qnsk7g9bf2ice9mqotqbrdo5c5kb5cssfinqhif0pjsasav376ub5g1kp/family1/6b018595756e4556b98cf92848e53c3f 2023-11-22 10:53:50,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:50,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:50,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208825ee49fd3f453388ba4704c0fd5aa1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208825ee49fd3f453388ba4704c0fd5aa1 2023-11-22 10:53:50,502 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281b47a58bdd924864afb0871546486914 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281b47a58bdd924864afb0871546486914 2023-11-22 10:53:50,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a3b0ecd292be4d52ad2aba85eb3c9fb3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a3b0ecd292be4d52ad2aba85eb3c9fb3 2023-11-22 10:53:50,503 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-22 10:53:50,503 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-22 10:53:50,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:50,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:50,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:53:50,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:53:50,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:53:50,505 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:53:50,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9560 sec 2023-11-22 10:53:50,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/7be91a21f1d9494aa5540bb87cc387eb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_] to archive 2023-11-22 10:53:50,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:53:50,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/2aa6561634d948b780949618a4130cf2 2023-11-22 10:53:50,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/7be91a21f1d9494aa5540bb87cc387eb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/7be91a21f1d9494aa5540bb87cc387eb 2023-11-22 10:53:50,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/family1/a020c5be0b6f4fb89388406443cf249b_SeqId_47_ 2023-11-22 10:53:50,606 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257 (was 252) Potentially hanging thread: hconnection-0x271a6099-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34656 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34630 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34770 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x0971a43c-SendThread(127.0.0.1:57046) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34808 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34806 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-93071633_17 at /127.0.0.1:34748 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34832 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-93071633_17 at /127.0.0.1:34728 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x271a6099-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34726 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x0971a43c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1529460914.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34710 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34820 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34762 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34694 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34872 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34822 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34884 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57046@0x0971a43c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_261311224_17 at /127.0.0.1:34788 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=645 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 336), ProcessCount=171 (was 171), AvailableMemoryMB=9757 (was 9983) 2023-11-22 10:53:50,618 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=171, AvailableMemoryMB=9756 2023-11-22 10:53:50,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:53:50,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:50,623 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:53:50,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-22 10:53:50,625 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:53:50,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-22 10:53:50,626 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,627 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512 empty. 2023-11-22 10:53:50,628 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-22 10:53:50,642 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-22 10:53:50,643 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d94bfc96b7868a4084ee7402665a512, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:53:50,649 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:50,649 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 7d94bfc96b7868a4084ee7402665a512, disabling compactions & flushes 2023-11-22 10:53:50,649 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,649 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,649 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. after waiting 0 ms 2023-11-22 10:53:50,649 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,650 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,650 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:50,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:53:50,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650430653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650430653"}]},"ts":"1700650430653"} 2023-11-22 10:53:50,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:53:50,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:53:50,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650430656"}]},"ts":"1700650430656"} 2023-11-22 10:53:50,657 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-22 10:53:50,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7d94bfc96b7868a4084ee7402665a512, ASSIGN}] 2023-11-22 10:53:50,664 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7d94bfc96b7868a4084ee7402665a512, ASSIGN 2023-11-22 10:53:50,665 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7d94bfc96b7868a4084ee7402665a512, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:53:50,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-22 10:53:50,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7d94bfc96b7868a4084ee7402665a512, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:50,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650430816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650430816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650430816"}]},"ts":"1700650430816"} 2023-11-22 10:53:50,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 7d94bfc96b7868a4084ee7402665a512, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:53:50,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-22 10:53:50,970 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:50,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d94bfc96b7868a4084ee7402665a512, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:53:50,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:53:50,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,976 INFO [StoreOpener-7d94bfc96b7868a4084ee7402665a512-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,977 DEBUG [StoreOpener-7d94bfc96b7868a4084ee7402665a512-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:53:50,977 DEBUG [StoreOpener-7d94bfc96b7868a4084ee7402665a512-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:53:50,978 INFO [StoreOpener-7d94bfc96b7868a4084ee7402665a512-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d94bfc96b7868a4084ee7402665a512 columnFamilyName family1 2023-11-22 10:53:50,979 INFO [StoreOpener-7d94bfc96b7868a4084ee7402665a512-1] regionserver.HStore(310): Store=7d94bfc96b7868a4084ee7402665a512/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:53:50,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:53:50,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:53:50,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d94bfc96b7868a4084ee7402665a512; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69209079, jitterRate=0.031295642256736755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:53:50,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:50,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512., pid=25, masterSystemTime=1700650430970 2023-11-22 10:53:50,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:50,990 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7d94bfc96b7868a4084ee7402665a512, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:50,990 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650430990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650430990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650430990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650430990"}]},"ts":"1700650430990"} 2023-11-22 10:53:50,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=25, resume processing ppid=24 2023-11-22 10:53:50,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 7d94bfc96b7868a4084ee7402665a512, server=jenkins-hbase4.apache.org,46051,1700650400831 in 174 msec 2023-11-22 10:53:50,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=24, resume processing ppid=23 2023-11-22 10:53:50,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7d94bfc96b7868a4084ee7402665a512, ASSIGN in 332 msec 2023-11-22 10:53:50,997 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:53:50,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650430997"}]},"ts":"1700650430997"} 2023-11-22 10:53:50,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-22 10:53:51,001 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:53:51,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 381 msec 2023-11-22 10:53:51,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-22 10:53:51,229 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-22 10:53:51,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,253 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:51,253 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:51,253 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:51,254 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:51,254 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,254 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,256 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:51,256 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:51,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:51,256 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:51,256 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:51,257 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:51,257 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:51,258 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:53:51,681 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c9ac12d6de9740708f32875005749215 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c9ac12d6de9740708f32875005749215 2023-11-22 10:53:52,085 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5fb527b7e5534991873777449c3c0685 2023-11-22 10:53:52,091 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5fb527b7e5534991873777449c3c0685 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685 2023-11-22 10:53:52,095 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-22 10:53:52,096 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 838ms, sequenceid=5, compaction requested=false 2023-11-22 10:53:52,096 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:52,097 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:52,097 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:52,099 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:52,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:52,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:52,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:52,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@586ff40a[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:52,101 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:52,101 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,102 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,102 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:52,102 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:52,102 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:52,102 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,102 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:52,104 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:52,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:52,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:52,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:52,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:52,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:52,107 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:52,108 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:52,108 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:52,108 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,108 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:52,109 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,109 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,109 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:52,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:52,110 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,112 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,114 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,114 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:52,114 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:52,114 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,115 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:52,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:52,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:52,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:52,115 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:52,116 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:52,216 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:52,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:52,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:52,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:52,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,223 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:52,223 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:52,223 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:52,223 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:52,224 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,224 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,225 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:52,225 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:52,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:52,226 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:52,226 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:52,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:52,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:52,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:52,227 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:52,227 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:52,227 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:52,227 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:52,227 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:52,227 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:52,227 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:52,228 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:53:52,642 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128582d81037f0c476d8521b85dc6963912 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128582d81037f0c476d8521b85dc6963912 2023-11-22 10:53:53,048 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/93b90bdd973441e89ebcf086e1ff537c 2023-11-22 10:53:53,054 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/93b90bdd973441e89ebcf086e1ff537c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c 2023-11-22 10:53:53,059 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:53:53,060 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 832ms, sequenceid=9, compaction requested=false 2023-11-22 10:53:53,061 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:53,061 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:53,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:53,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:53,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:53,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:53,067 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,067 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,068 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,068 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:53,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f682bd7[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:53,069 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:53,069 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,070 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:53,070 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:53,070 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:53,070 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,071 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:53,072 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:53,072 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,072 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,072 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:53,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:53,074 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:53,074 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:53,074 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:53,074 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,075 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:53,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:53,077 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,078 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,081 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:53,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:53,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:53,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,082 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:53,082 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:53,182 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:53,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:53,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:53,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:53,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,189 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:53,189 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:53,189 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:53,189 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:53,189 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,189 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,191 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,191 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:53,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:53,191 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,191 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:53,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,192 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:53,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,192 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:53,192 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:53,192 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:53,193 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:53,193 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:53,193 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:53,193 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:53,193 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:53,609 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201292e47c5eb5a40c48553d374ab76dc68 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201292e47c5eb5a40c48553d374ab76dc68 2023-11-22 10:53:53,615 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/e39603869d7c4ec29a0cbee9e3bea3ed 2023-11-22 10:53:53,620 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/e39603869d7c4ec29a0cbee9e3bea3ed as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed 2023-11-22 10:53:53,624 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed, entries=1, sequenceid=13, filesize=4.9 K 2023-11-22 10:53:53,625 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 432ms, sequenceid=13, compaction requested=true 2023-11-22 10:53:53,625 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:53,625 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:53,627 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:53,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18ca1a93[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:53,629 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:53,629 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,630 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:53,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:53,633 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:53,633 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,633 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,633 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:53,635 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:53,635 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:53,635 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:53,635 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,636 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:53,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:53,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:53,638 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,639 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,641 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:53,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:53,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:53,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:53,642 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:53,642 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:53,743 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:53,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:53,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:53,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:53,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,750 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:53,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:53,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:53,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:53,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,750 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:53,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:53,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:53,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,753 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:53,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:53,754 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:53,754 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:53,754 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:54,168 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e2ea0dcf8f7a42d4bd2d45affa18a2fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e2ea0dcf8f7a42d4bd2d45affa18a2fc 2023-11-22 10:53:54,574 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/d898f7ceb1954b7c8e7b5b923594c5c6 2023-11-22 10:53:54,579 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/d898f7ceb1954b7c8e7b5b923594c5c6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6 2023-11-22 10:53:54,584 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6, entries=1, sequenceid=17, filesize=4.9 K 2023-11-22 10:53:54,585 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 831ms, sequenceid=17, compaction requested=true 2023-11-22 10:53:54,585 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:54,585 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:54,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:54,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:54,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:54,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d5a2881[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:54,590 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:54,590 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,592 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,592 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:54,592 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:54,592 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:54,592 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,592 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:54,595 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:54,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:54,597 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:54,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:54,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:54,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,598 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:54,599 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,599 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:54,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,599 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:54,600 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,601 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,607 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:54,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:54,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:54,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:54,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,608 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,608 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,608 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:54,608 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:54,608 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:54,708 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:54,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:54,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:54,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:54,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,715 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:54,715 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:54,715 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:54,715 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:54,716 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,716 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:54,723 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:54,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:54,724 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:54,724 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:54,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:54,725 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:54,725 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:54,725 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:55,139 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a19497c3261143a7912aee5418aff16a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a19497c3261143a7912aee5418aff16a 2023-11-22 10:53:55,546 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/90bf190e6b144bb58783f0008adc8ab0 2023-11-22 10:53:55,551 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/90bf190e6b144bb58783f0008adc8ab0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0 2023-11-22 10:53:55,556 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-22 10:53:55,557 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 832ms, sequenceid=21, compaction requested=true 2023-11-22 10:53:55,557 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:55,557 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,559 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ab24284[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:55,561 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:55,561 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,562 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:55,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:55,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:55,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:55,567 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:55,567 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:55,567 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:55,567 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,567 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:55,570 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,570 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:55,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,570 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:55,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:55,571 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,572 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,574 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,574 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,574 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:55,574 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:55,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:55,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,575 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:55,575 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:55,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:55,675 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:55,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:55,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:55,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,682 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:55,682 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:55,682 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:55,682 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:55,682 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,682 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,684 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,684 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:55,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:55,684 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:55,684 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:55,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:55,685 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:55,685 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:55,686 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:56,099 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310ebd14b707de4368ba936932e7d2be9e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310ebd14b707de4368ba936932e7d2be9e 2023-11-22 10:53:56,505 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/7ad05e86addf414c95c6ed6c09b31407 2023-11-22 10:53:56,506 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:53:56,510 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/7ad05e86addf414c95c6ed6c09b31407 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407 2023-11-22 10:53:56,515 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407, entries=1, sequenceid=25, filesize=4.9 K 2023-11-22 10:53:56,516 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 830ms, sequenceid=25, compaction requested=true 2023-11-22 10:53:56,516 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:56,516 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:56,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:56,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:56,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:56,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:56,518 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,518 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:56,518 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,518 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:56,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:56,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54fae296[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:56,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:56,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,522 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:56,523 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,523 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:56,525 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:56,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,525 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:56,525 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:56,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:56,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:56,528 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:56,528 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:56,528 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:56,528 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,528 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:56,530 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,530 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,530 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:56,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:56,530 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,532 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:56,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:56,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:56,535 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:56,535 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:56,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:56,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:53:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:56,636 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:56,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:56,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:56,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:56,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,642 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:56,642 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:56,643 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:56,643 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:56,643 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,643 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,648 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:56,648 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:56,649 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:56,649 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:56,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:56,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:56,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:56,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:56,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:56,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:56,650 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:56,650 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:56,650 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:56,664 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101820604cf70f14be497684727f0b95361 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101820604cf70f14be497684727f0b95361 2023-11-22 10:53:57,070 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/deb60109848d43979025be557d98d21d 2023-11-22 10:53:57,076 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/deb60109848d43979025be557d98d21d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d 2023-11-22 10:53:57,080 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d, entries=1, sequenceid=29, filesize=4.9 K 2023-11-22 10:53:57,081 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 431ms, sequenceid=29, compaction requested=true 2023-11-22 10:53:57,081 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:57,081 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:57,083 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,083 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:57,083 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,083 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:57,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:57,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2c7418[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:57,085 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:57,085 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,086 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:57,087 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,087 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:57,088 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:57,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:57,091 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:57,091 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:57,091 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:57,091 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,091 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:57,096 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,096 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,096 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:57,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:57,097 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,098 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:57,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:57,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,101 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:57,102 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:57,101 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,102 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,202 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:57,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:57,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:57,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:57,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,209 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:57,209 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:57,209 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:57,209 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:57,210 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,210 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,211 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:57,211 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:57,212 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:57,212 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:57,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:57,213 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:57,213 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:57,213 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:57,627 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103898c05a59f8c42aa9014468f71b1b397 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103898c05a59f8c42aa9014468f71b1b397 2023-11-22 10:53:58,033 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/692d9e02074f4bcd9893dab4da6e7ff7 2023-11-22 10:53:58,038 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/692d9e02074f4bcd9893dab4da6e7ff7 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7 2023-11-22 10:53:58,043 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7, entries=1, sequenceid=33, filesize=4.9 K 2023-11-22 10:53:58,044 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 831ms, sequenceid=33, compaction requested=true 2023-11-22 10:53:58,045 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:58,045 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:58,045 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:58,045 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:58,045 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,045 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:58,045 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:58,047 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:58,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:58,049 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:58,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40ee593c[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:58,049 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,051 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:58,051 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,051 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:58,053 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,053 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:58,053 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:58,053 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:58,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:58,055 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:58,055 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:58,055 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:58,055 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,055 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:58,057 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,057 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:58,057 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:58,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:58,058 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:58,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:58,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:58,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:58,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:58,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,061 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,062 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:58,162 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:58,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:58,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,169 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:58,169 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:58,169 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:58,169 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:58,169 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,169 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,172 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,172 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:58,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:58,172 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:58,172 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:58,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:58,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:58,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:58,174 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:58,174 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:58,174 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:58,174 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:58,587 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907226047df7e644a42a7c4a69bbbbc7d2a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907226047df7e644a42a7c4a69bbbbc7d2a 2023-11-22 10:53:58,993 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5d57a657171247fd8cbec5d2dd8b2bdd 2023-11-22 10:53:58,999 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5d57a657171247fd8cbec5d2dd8b2bdd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd 2023-11-22 10:53:59,004 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd, entries=1, sequenceid=37, filesize=4.9 K 2023-11-22 10:53:59,005 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 831ms, sequenceid=37, compaction requested=true 2023-11-22 10:53:59,005 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:59,005 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:59,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:59,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:59,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:59,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:59,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,007 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,007 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,007 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:59,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f095c7[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:59,009 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:59,009 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,010 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,010 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:59,010 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:59,010 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:59,010 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,010 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:59,011 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,012 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,012 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:59,012 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:59,014 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:59,014 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:59,014 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:59,014 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,014 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:59,017 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,017 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,017 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:59,017 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,019 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:59,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:59,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:59,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:59,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:59,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:59,026 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:59,026 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:59,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:59,027 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:59,127 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:53:59,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:53:59,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:53:59,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:53:59,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,134 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:59,134 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:59,134 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:53:59,134 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:53:59,135 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,135 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,136 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,136 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:59,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:59,136 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,137 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:53:59,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:53:59,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,138 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:53:59,138 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:59,138 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. started... 2023-11-22 10:53:59,138 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d94bfc96b7868a4084ee7402665a512 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:53:59,552 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120405e1bd6ac9e4b04bda2fd39e606c4fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120405e1bd6ac9e4b04bda2fd39e606c4fc 2023-11-22 10:53:59,958 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5c6368f312114df7b1a262679d0a1160 2023-11-22 10:53:59,964 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/5c6368f312114df7b1a262679d0a1160 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160 2023-11-22 10:53:59,968 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160, entries=1, sequenceid=41, filesize=4.9 K 2023-11-22 10:53:59,970 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7d94bfc96b7868a4084ee7402665a512 in 831ms, sequenceid=41, compaction requested=true 2023-11-22 10:53:59,970 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:53:59,970 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:53:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:53:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:53:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:53:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:53:59,972 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,972 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,972 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,972 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:53:59,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:53:59,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b9d361d[Count = 0] remaining members to acquire global barrier 2023-11-22 10:53:59,974 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:53:59,974 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,984 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:53:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:53:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:53:59,985 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,985 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:53:59,986 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:53:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:53:59,989 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:53:59,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:53:59,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:53:59,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,989 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:53:59,991 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,991 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:53:59,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,991 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:53:59,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:53:59,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,993 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:53:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-22 10:53:59,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:53:59,996 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:53:59,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:53:59,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:53:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:53:59,997 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,997 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:53:59,997 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:53:59,997 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,997 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-22 10:53:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:53:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:00,097 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:00,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:00,099 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-22 10:54:00,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:00,102 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:00,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:00,103 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651040103 2023-11-22 10:54:00,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:54:00,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-22 10:54:00,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:00,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x4201d6a9 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:00,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64908508, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:00,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:00,962 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c273541d973c4dac9f9a769e32cad191 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c273541d973c4dac9f9a769e32cad191 2023-11-22 10:54:00,963 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:00,977 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:00,978 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:00,985 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:00,987 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:00,998 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/47b774f77e404f8994d82f7281d00a33 first=Optional[r3] last=Optional[r6] 2023-11-22 10:54:00,998 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/47b774f77e404f8994d82f7281d00a33}] 2023-11-22 10:54:01,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/47b774f77e404f8994d82f7281d00a33 for inclusion in 7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:54:01,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-22 10:54:01,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:01,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:54:01,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/47b774f77e404f8994d82f7281d00a33 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ecbk33e09s4ecbtskudritj0kjdbi6lkgp9slajagjg4rije6l9foggfqjbu1i97/family1/47b774f77e404f8994d82f7281d00a33 2023-11-22 10:54:01,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ecbk33e09s4ecbtskudritj0kjdbi6lkgp9slajagjg4rije6l9foggfqjbu1i97/family1/47b774f77e404f8994d82f7281d00a33 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_ 2023-11-22 10:54:01,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ecbk33e09s4ecbtskudritj0kjdbi6lkgp9slajagjg4rije6l9foggfqjbu1i97/family1/47b774f77e404f8994d82f7281d00a33 into 7d94bfc96b7868a4084ee7402665a512/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_ - updating store file list. 2023-11-22 10:54:01,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_ into 7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:54:01,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ecbk33e09s4ecbtskudritj0kjdbi6lkgp9slajagjg4rije6l9foggfqjbu1i97/family1/47b774f77e404f8994d82f7281d00a33 into 7d94bfc96b7868a4084ee7402665a512/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_) 2023-11-22 10:54:01,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ecbk33e09s4ecbtskudritj0kjdbi6lkgp9slajagjg4rije6l9foggfqjbu1i97/family1/47b774f77e404f8994d82f7281d00a33 2023-11-22 10:54:01,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:54:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:54:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 7d94bfc96b7868a4084ee7402665a512/family1 is initiating minor compaction 2023-11-22 10:54:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32df7866; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:01,020 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7d94bfc96b7868a4084ee7402665a512/family1 in testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:54:01,020 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp, totalSize=50.0 K 2023-11-22 10:54:01,020 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 93b90bdd973441e89ebcf086e1ff537c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:54:01,020 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting e39603869d7c4ec29a0cbee9e3bea3ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d898f7ceb1954b7c8e7b5b923594c5c6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 90bf190e6b144bb58783f0008adc8ab0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 7ad05e86addf414c95c6ed6c09b31407, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting deb60109848d43979025be557d98d21d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 692d9e02074f4bcd9893dab4da6e7ff7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5d57a657171247fd8cbec5d2dd8b2bdd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5c6368f312114df7b1a262679d0a1160, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:54:01,021 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:54:01,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:01,023 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:01,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a19497c3261143a7912aee5418aff16a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a19497c3261143a7912aee5418aff16a 2023-11-22 10:54:01,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310ebd14b707de4368ba936932e7d2be9e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310ebd14b707de4368ba936932e7d2be9e 2023-11-22 10:54:01,028 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101820604cf70f14be497684727f0b95361 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101820604cf70f14be497684727f0b95361 2023-11-22 10:54:01,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103898c05a59f8c42aa9014468f71b1b397 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103898c05a59f8c42aa9014468f71b1b397 2023-11-22 10:54:01,029 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-22 10:54:01,029 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,052 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7d94bfc96b7868a4084ee7402665a512#family1#compaction#34 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:01,065 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/734ad51481d1436aabe16d3d52e0a414 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/734ad51481d1436aabe16d3d52e0a414 2023-11-22 10:54:01,070 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7d94bfc96b7868a4084ee7402665a512/family1 of 7d94bfc96b7868a4084ee7402665a512 into 734ad51481d1436aabe16d3d52e0a414(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:01,070 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:54:01,070 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700650441020; duration=0sec 2023-11-22 10:54:01,070 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:01,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_] to archive 2023-11-22 10:54:01,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:01,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/93b90bdd973441e89ebcf086e1ff537c 2023-11-22 10:54:01,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/e39603869d7c4ec29a0cbee9e3bea3ed 2023-11-22 10:54:01,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/d898f7ceb1954b7c8e7b5b923594c5c6 2023-11-22 10:54:01,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/90bf190e6b144bb58783f0008adc8ab0 2023-11-22 10:54:01,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/7ad05e86addf414c95c6ed6c09b31407 2023-11-22 10:54:01,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/deb60109848d43979025be557d98d21d 2023-11-22 10:54:01,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/692d9e02074f4bcd9893dab4da6e7ff7 2023-11-22 10:54:01,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5d57a657171247fd8cbec5d2dd8b2bdd 2023-11-22 10:54:01,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5c6368f312114df7b1a262679d0a1160 2023-11-22 10:54:01,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/c189aab7e20c411aa87d7c22e536e2a1_SeqId_44_ 2023-11-22 10:54:01,864 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120553e846bb08b14953b61d451bd94891c3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120553e846bb08b14953b61d451bd94891c3 2023-11-22 10:54:01,865 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:01,891 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd456cfd92a546029e608f41ee51f8fa first=Optional[r1] last=Optional[r2] 2023-11-22 10:54:01,891 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd456cfd92a546029e608f41ee51f8fa}] 2023-11-22 10:54:01,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd456cfd92a546029e608f41ee51f8fa for inclusion in 7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:54:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-22 10:54:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:54:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd456cfd92a546029e608f41ee51f8fa to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vnc65u21nq4l1t31b6kspi8u2knl9o9lu6r7huh1qr08lpftppavqmsuo11g0ecp/family1/bd456cfd92a546029e608f41ee51f8fa 2023-11-22 10:54:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vnc65u21nq4l1t31b6kspi8u2knl9o9lu6r7huh1qr08lpftppavqmsuo11g0ecp/family1/bd456cfd92a546029e608f41ee51f8fa as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_ 2023-11-22 10:54:01,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vnc65u21nq4l1t31b6kspi8u2knl9o9lu6r7huh1qr08lpftppavqmsuo11g0ecp/family1/bd456cfd92a546029e608f41ee51f8fa into 7d94bfc96b7868a4084ee7402665a512/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_ - updating store file list. 2023-11-22 10:54:01,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_ into 7d94bfc96b7868a4084ee7402665a512/family1 2023-11-22 10:54:01,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vnc65u21nq4l1t31b6kspi8u2knl9o9lu6r7huh1qr08lpftppavqmsuo11g0ecp/family1/bd456cfd92a546029e608f41ee51f8fa into 7d94bfc96b7868a4084ee7402665a512/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_) 2023-11-22 10:54:01,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vnc65u21nq4l1t31b6kspi8u2knl9o9lu6r7huh1qr08lpftppavqmsuo11g0ecp/family1/bd456cfd92a546029e608f41ee51f8fa 2023-11-22 10:54:01,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:54:01,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:54:01,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 7d94bfc96b7868a4084ee7402665a512/family1 is initiating minor compaction (all files) 2023-11-22 10:54:01,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d9d297f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:01,911 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7d94bfc96b7868a4084ee7402665a512/family1 in testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:54:01,911 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/734ad51481d1436aabe16d3d52e0a414, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp, totalSize=176.8 K 2023-11-22 10:54:01,911 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5fb527b7e5534991873777449c3c0685, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:54:01,912 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 734ad51481d1436aabe16d3d52e0a414, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:54:01,912 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 246a09fa7267474ea96e124961ffae64_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224734 2023-11-22 10:54:01,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:01,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:01,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201292e47c5eb5a40c48553d374ab76dc68 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201292e47c5eb5a40c48553d374ab76dc68 2023-11-22 10:54:01,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e2ea0dcf8f7a42d4bd2d45affa18a2fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e2ea0dcf8f7a42d4bd2d45affa18a2fc 2023-11-22 10:54:01,916 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-22 10:54:01,916 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-22 10:54:01,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:01,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:01,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:01,918 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:01,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8180 sec 2023-11-22 10:54:01,930 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7d94bfc96b7868a4084ee7402665a512#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:02,018 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=263 (was 257) - Thread LEAK? -, OpenFileDescriptor=646 (was 645) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 322), ProcessCount=171 (was 171), AvailableMemoryMB=9673 (was 9756) 2023-11-22 10:54:02,028 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=263, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=171, AvailableMemoryMB=9672 2023-11-22 10:54:02,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-22 10:54:02,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:02,033 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:02,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-22 10:54:02,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:02,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:02,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:02,036 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:02,036 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531 empty. 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6 empty. 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1 empty. 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:02,037 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:02,037 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-22 10:54:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:02,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:02,446 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:02,448 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 43eaf7eb7374ce887acb8b9ce93e6ee1, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:02,448 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 364f7661920cd9dfa5edfb250e4fabe6, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:02,448 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d460479f2059a1ac768b768200cf531, NAME => 'testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:02,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:02,750 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/.tmp/family1/a3797feb12af4f389dc8ad9e09e820d6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/a3797feb12af4f389dc8ad9e09e820d6 2023-11-22 10:54:02,755 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7d94bfc96b7868a4084ee7402665a512/family1 of 7d94bfc96b7868a4084ee7402665a512 into a3797feb12af4f389dc8ad9e09e820d6(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:02,756 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:54:02,756 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1700650441910; duration=0sec 2023-11-22 10:54:02,756 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:02,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/734ad51481d1436aabe16d3d52e0a414, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_] to archive 2023-11-22 10:54:02,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:02,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/5fb527b7e5534991873777449c3c0685 2023-11-22 10:54:02,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/734ad51481d1436aabe16d3d52e0a414 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/734ad51481d1436aabe16d3d52e0a414 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:02,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/family1/246a09fa7267474ea96e124961ffae64_SeqId_47_ 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 43eaf7eb7374ce887acb8b9ce93e6ee1, disabling compactions & flushes 2023-11-22 10:54:02,855 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. after waiting 0 ms 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:02,855 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 43eaf7eb7374ce887acb8b9ce93e6ee1: 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 364f7661920cd9dfa5edfb250e4fabe6, disabling compactions & flushes 2023-11-22 10:54:02,855 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. after waiting 0 ms 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:02,855 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:02,855 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:02,856 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 4d460479f2059a1ac768b768200cf531, disabling compactions & flushes 2023-11-22 10:54:02,856 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:02,856 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:02,856 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. after waiting 0 ms 2023-11-22 10:54:02,856 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:02,856 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:02,856 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 4d460479f2059a1ac768b768200cf531: 2023-11-22 10:54:02,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:02,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700650442859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650442859"}]},"ts":"1700650442859"} 2023-11-22 10:54:02,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650442859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650442859"}]},"ts":"1700650442859"} 2023-11-22 10:54:02,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650442859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650442859"}]},"ts":"1700650442859"} 2023-11-22 10:54:02,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-22 10:54:02,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:02,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650442863"}]},"ts":"1700650442863"} 2023-11-22 10:54:02,864 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-22 10:54:02,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d460479f2059a1ac768b768200cf531, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=43eaf7eb7374ce887acb8b9ce93e6ee1, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=364f7661920cd9dfa5edfb250e4fabe6, ASSIGN}] 2023-11-22 10:54:02,869 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=364f7661920cd9dfa5edfb250e4fabe6, ASSIGN 2023-11-22 10:54:02,869 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=43eaf7eb7374ce887acb8b9ce93e6ee1, ASSIGN 2023-11-22 10:54:02,869 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d460479f2059a1ac768b768200cf531, ASSIGN 2023-11-22 10:54:02,870 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=43eaf7eb7374ce887acb8b9ce93e6ee1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:02,870 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d460479f2059a1ac768b768200cf531, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:02,870 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=364f7661920cd9dfa5edfb250e4fabe6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:03,021 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=364f7661920cd9dfa5edfb250e4fabe6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,021 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=43eaf7eb7374ce887acb8b9ce93e6ee1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,022 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4d460479f2059a1ac768b768200cf531, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650443021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650443021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650443021"}]},"ts":"1700650443021"} 2023-11-22 10:54:03,022 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700650443021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650443021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650443021"}]},"ts":"1700650443021"} 2023-11-22 10:54:03,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650443021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650443021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650443021"}]},"ts":"1700650443021"} 2023-11-22 10:54:03,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 364f7661920cd9dfa5edfb250e4fabe6, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:03,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 43eaf7eb7374ce887acb8b9ce93e6ee1, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:03,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 4d460479f2059a1ac768b768200cf531, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:03,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:03,176 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:03,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43eaf7eb7374ce887acb8b9ce93e6ee1, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-22 10:54:03,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:03,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,181 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,183 DEBUG [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/family1 2023-11-22 10:54:03,183 DEBUG [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/family1 2023-11-22 10:54:03,183 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43eaf7eb7374ce887acb8b9ce93e6ee1 columnFamilyName family1 2023-11-22 10:54:03,185 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] regionserver.HStore(310): Store=43eaf7eb7374ce887acb8b9ce93e6ee1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,185 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,186 DEBUG [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/family2 2023-11-22 10:54:03,186 DEBUG [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/family2 2023-11-22 10:54:03,187 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43eaf7eb7374ce887acb8b9ce93e6ee1 columnFamilyName family2 2023-11-22 10:54:03,188 INFO [StoreOpener-43eaf7eb7374ce887acb8b9ce93e6ee1-1] regionserver.HStore(310): Store=43eaf7eb7374ce887acb8b9ce93e6ee1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:54:03,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:54:03,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:03,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 43eaf7eb7374ce887acb8b9ce93e6ee1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69971086, jitterRate=0.042650431394577026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:54:03,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 43eaf7eb7374ce887acb8b9ce93e6ee1: 2023-11-22 10:54:03,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1., pid=32, masterSystemTime=1700650443176 2023-11-22 10:54:03,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:03,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:03,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:03,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d460479f2059a1ac768b768200cf531, NAME => 'testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.', STARTKEY => '', ENDKEY => '1'} 2023-11-22 10:54:03,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:03,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=43eaf7eb7374ce887acb8b9ce93e6ee1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700650443197"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650443197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650443197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650443197"}]},"ts":"1700650443197"} 2023-11-22 10:54:03,199 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,201 DEBUG [StoreOpener-4d460479f2059a1ac768b768200cf531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/family1 2023-11-22 10:54:03,201 DEBUG [StoreOpener-4d460479f2059a1ac768b768200cf531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/family1 2023-11-22 10:54:03,201 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d460479f2059a1ac768b768200cf531 columnFamilyName family1 2023-11-22 10:54:03,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=32, resume processing ppid=29 2023-11-22 10:54:03,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 43eaf7eb7374ce887acb8b9ce93e6ee1, server=jenkins-hbase4.apache.org,46051,1700650400831 in 175 msec 2023-11-22 10:54:03,202 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] regionserver.HStore(310): Store=4d460479f2059a1ac768b768200cf531/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,203 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=43eaf7eb7374ce887acb8b9ce93e6ee1, ASSIGN in 335 msec 2023-11-22 10:54:03,204 DEBUG [StoreOpener-4d460479f2059a1ac768b768200cf531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/family2 2023-11-22 10:54:03,205 DEBUG [StoreOpener-4d460479f2059a1ac768b768200cf531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/family2 2023-11-22 10:54:03,205 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d460479f2059a1ac768b768200cf531 columnFamilyName family2 2023-11-22 10:54:03,206 INFO [StoreOpener-4d460479f2059a1ac768b768200cf531-1] regionserver.HStore(310): Store=4d460479f2059a1ac768b768200cf531/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:54:03,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d460479f2059a1ac768b768200cf531 2023-11-22 10:54:03,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:03,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d460479f2059a1ac768b768200cf531; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63233260, jitterRate=-0.05775099992752075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:54:03,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d460479f2059a1ac768b768200cf531: 2023-11-22 10:54:03,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531., pid=33, masterSystemTime=1700650443176 2023-11-22 10:54:03,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:03,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:03,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:03,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 364f7661920cd9dfa5edfb250e4fabe6, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.', STARTKEY => '2', ENDKEY => ''} 2023-11-22 10:54:03,216 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4d460479f2059a1ac768b768200cf531, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,216 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650443215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650443215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650443215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650443215"}]},"ts":"1700650443215"} 2023-11-22 10:54:03,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:03,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,217 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,218 DEBUG [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1 2023-11-22 10:54:03,218 DEBUG [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1 2023-11-22 10:54:03,219 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 364f7661920cd9dfa5edfb250e4fabe6 columnFamilyName family1 2023-11-22 10:54:03,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=33, resume processing ppid=28 2023-11-22 10:54:03,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 4d460479f2059a1ac768b768200cf531, server=jenkins-hbase4.apache.org,46051,1700650400831 in 192 msec 2023-11-22 10:54:03,220 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] regionserver.HStore(310): Store=364f7661920cd9dfa5edfb250e4fabe6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d460479f2059a1ac768b768200cf531, ASSIGN in 352 msec 2023-11-22 10:54:03,220 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,222 DEBUG [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family2 2023-11-22 10:54:03,222 DEBUG [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family2 2023-11-22 10:54:03,222 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 364f7661920cd9dfa5edfb250e4fabe6 columnFamilyName family2 2023-11-22 10:54:03,223 INFO [StoreOpener-364f7661920cd9dfa5edfb250e4fabe6-1] regionserver.HStore(310): Store=364f7661920cd9dfa5edfb250e4fabe6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:03,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:54:03,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:54:03,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:03,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 364f7661920cd9dfa5edfb250e4fabe6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75226784, jitterRate=0.12096643447875977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:54:03,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:03,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6., pid=31, masterSystemTime=1700650443176 2023-11-22 10:54:03,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:03,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:03,232 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=364f7661920cd9dfa5edfb250e4fabe6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:03,232 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700650443231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650443231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650443231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650443231"}]},"ts":"1700650443231"} 2023-11-22 10:54:03,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=31, resume processing ppid=30 2023-11-22 10:54:03,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 364f7661920cd9dfa5edfb250e4fabe6, server=jenkins-hbase4.apache.org,46051,1700650400831 in 210 msec 2023-11-22 10:54:03,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=30, resume processing ppid=27 2023-11-22 10:54:03,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=364f7661920cd9dfa5edfb250e4fabe6, ASSIGN in 367 msec 2023-11-22 10:54:03,237 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:54:03,237 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650443237"}]},"ts":"1700650443237"} 2023-11-22 10:54:03,238 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-22 10:54:03,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:54:03,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2100 sec 2023-11-22 10:54:04,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-22 10:54:04,140 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-22 10:54:04,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:04,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,149 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-22 10:54:04,149 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:04,149 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-22 10:54:04,149 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-22 10:54:04,150 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,150 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,151 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:04,151 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:04,152 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,152 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-22 10:54:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-22 10:54:04,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:04,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. started... 2023-11-22 10:54:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:54:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:04,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43eaf7eb7374ce887acb8b9ce93e6ee1: 2023-11-22 10:54:04,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:04,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:04,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:04,154 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:54:04,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. started... 2023-11-22 10:54:04,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. started... 2023-11-22 10:54:04,155 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d460479f2059a1ac768b768200cf531: 2023-11-22 10:54:04,156 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:04,156 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 364f7661920cd9dfa5edfb250e4fabe6 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-22 10:54:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:54:04,571 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122d1b16572ef8346e2bf371419b6da4e31 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122d1b16572ef8346e2bf371419b6da4e31 2023-11-22 10:54:04,578 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-22 10:54:04,977 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp/family1/10620575e2b047a6938b82ac5af02286 2023-11-22 10:54:04,982 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp/family1/10620575e2b047a6938b82ac5af02286 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286 2023-11-22 10:54:04,987 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286, entries=1, sequenceid=5, filesize=4.9 K 2023-11-22 10:54:04,988 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 364f7661920cd9dfa5edfb250e4fabe6 in 832ms, sequenceid=5, compaction requested=false 2023-11-22 10:54:04,988 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:04,988 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:04,988 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:54:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:54:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-22 10:54:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-22 10:54:04,990 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,990 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:04,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:04,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-22 10:54:04,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ee01c2[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:04,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-22 10:54:04,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,994 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,994 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-22 10:54:04,994 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-22 10:54:04,994 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,994 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:04,994 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:04,997 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-22 10:54:04,997 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,997 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:04,997 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-22 10:54:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:04,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-22 10:54:04,999 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-22 10:54:05,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:05,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:05,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,000 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:05,001 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,001 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,001 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:05,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:05,002 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:05,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,003 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:05,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-22 10:54:05,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:05,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-22 10:54:05,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:05,006 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:05,006 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:05,007 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:05,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,007 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:05,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,107 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:05,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:05,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:05,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:05,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,114 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-22 10:54:05,114 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:05,114 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-22 10:54:05,115 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-22 10:54:05,115 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,115 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,116 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,116 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:05,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:05,117 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,117 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,118 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,118 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-22 10:54:05,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-22 10:54:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. started... 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:54:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43eaf7eb7374ce887acb8b9ce93e6ee1: 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. started... 2023-11-22 10:54:05,119 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:54:05,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:05,119 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 364f7661920cd9dfa5edfb250e4fabe6 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-22 10:54:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:54:05,119 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. started... 2023-11-22 10:54:05,119 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d460479f2059a1ac768b768200cf531: 2023-11-22 10:54:05,119 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:54:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:54:05,532 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122b442336ffc4845c09ecb05bbca745b70 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122b442336ffc4845c09ecb05bbca745b70 2023-11-22 10:54:05,938 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp/family1/f50d8ae20356476fbaf53ea9c2abc39c 2023-11-22 10:54:05,943 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp/family1/f50d8ae20356476fbaf53ea9c2abc39c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c 2023-11-22 10:54:05,947 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c, entries=2, sequenceid=9, filesize=5.0 K 2023-11-22 10:54:05,948 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 364f7661920cd9dfa5edfb250e4fabe6 in 829ms, sequenceid=9, compaction requested=false 2023-11-22 10:54:05,948 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:05,948 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:54:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:54:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-22 10:54:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-22 10:54:05,953 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:05,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:05,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-22 10:54:05,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fb8fda[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:05,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-22 10:54:05,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,956 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,956 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-22 10:54:05,956 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-22 10:54:05,956 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:05,956 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,956 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:05,958 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-22 10:54:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-22 10:54:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:05,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-22 10:54:05,960 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-22 10:54:05,960 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:05,960 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:05,960 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,960 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:05,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:05,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,963 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:05,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,965 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:05,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:05,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-22 10:54:05,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:05,973 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:05,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:05,973 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:05,974 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:05,974 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:06,074 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:06,083 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-22 10:54:06,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-22 10:54:06,085 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-22 10:54:06,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:06,086 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651046086 2023-11-22 10:54:06,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:06,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-22 10:54:06,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-22 10:54:06,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x34ef8f18 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:06,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5437f448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:06,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231122 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-22 10:54:06,925 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122dcbb7a6bfe314365b6f9c66478ff63f9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122dcbb7a6bfe314365b6f9c66478ff63f9 2023-11-22 10:54:06,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-22 10:54:06,939 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:06,940 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:06,948 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:06,950 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:06,960 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231122/family1/fdbe7045b603423dab7dd9969e08e347 first=Optional[k0] last=Optional[k1] 2023-11-22 10:54:06,961 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231122/family1/fdbe7045b603423dab7dd9969e08e347}] 2023-11-22 10:54:06,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231122/family1/fdbe7045b603423dab7dd9969e08e347 for inclusion in 364f7661920cd9dfa5edfb250e4fabe6/family1 2023-11-22 10:54:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-22 10:54:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-22 10:54:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:06,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231122/family1/fdbe7045b603423dab7dd9969e08e347 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testScannerOnBulkLoadRefHFiles__ohnivguf1k0332n829u1ghjb31g0i57vmhfsr8arptok0bhh2bdact3tjrp96fc1/family1/fdbe7045b603423dab7dd9969e08e347 2023-11-22 10:54:06,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testScannerOnBulkLoadRefHFiles__ohnivguf1k0332n829u1ghjb31g0i57vmhfsr8arptok0bhh2bdact3tjrp96fc1/family1/fdbe7045b603423dab7dd9969e08e347 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_ 2023-11-22 10:54:06,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testScannerOnBulkLoadRefHFiles__ohnivguf1k0332n829u1ghjb31g0i57vmhfsr8arptok0bhh2bdact3tjrp96fc1/family1/fdbe7045b603423dab7dd9969e08e347 into 364f7661920cd9dfa5edfb250e4fabe6/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_ - updating store file list. 2023-11-22 10:54:06,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_ into 364f7661920cd9dfa5edfb250e4fabe6/family1 2023-11-22 10:54:06,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testScannerOnBulkLoadRefHFiles__ohnivguf1k0332n829u1ghjb31g0i57vmhfsr8arptok0bhh2bdact3tjrp96fc1/family1/fdbe7045b603423dab7dd9969e08e347 into 364f7661920cd9dfa5edfb250e4fabe6/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_) 2023-11-22 10:54:06,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testScannerOnBulkLoadRefHFiles__ohnivguf1k0332n829u1ghjb31g0i57vmhfsr8arptok0bhh2bdact3tjrp96fc1/family1/fdbe7045b603423dab7dd9969e08e347 2023-11-22 10:54:06,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:54:06,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:54:06,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 364f7661920cd9dfa5edfb250e4fabe6/family1 is initiating minor compaction (all files) 2023-11-22 10:54:06,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7556d34b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:06,980 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 364f7661920cd9dfa5edfb250e4fabe6/family1 in testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:54:06,980 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp, totalSize=15.1 K 2023-11-22 10:54:06,980 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 10620575e2b047a6938b82ac5af02286, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650444140 2023-11-22 10:54:06,981 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting f50d8ae20356476fbaf53ea9c2abc39c, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650444140 2023-11-22 10:54:06,981 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d82db065831a4296a7295018d1201800_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650444140 2023-11-22 10:54:06,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-22 10:54:06,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:06,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122b442336ffc4845c09ecb05bbca745b70 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122b442336ffc4845c09ecb05bbca745b70 2023-11-22 10:54:06,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122d1b16572ef8346e2bf371419b6da4e31 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231122d1b16572ef8346e2bf371419b6da4e31 2023-11-22 10:54:06,986 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-22 10:54:06,986 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231122' 2023-11-22 10:54:06,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231122 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-22 10:54:06,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-22 10:54:06,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:06,987 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-22 10:54:06,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 904 msec 2023-11-22 10:54:06,992 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 364f7661920cd9dfa5edfb250e4fabe6#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:07,025 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 263), OpenFileDescriptor=644 (was 646), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 272), ProcessCount=171 (was 171), AvailableMemoryMB=9631 (was 9672) 2023-11-22 10:54:07,036 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=171, AvailableMemoryMB=9631 2023-11-22 10:54:07,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:54:07,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:07,060 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:07,061 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x586dde8d to 127.0.0.1:57046 2023-11-22 10:54:07,061 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:07,061 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:07,061 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:07,062 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0971a43c to 127.0.0.1:57046 2023-11-22 10:54:07,062 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:07,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-22 10:54:07,062 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:07,063 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34ef8f18 to 127.0.0.1:57046 2023-11-22 10:54:07,063 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:07,063 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-22 10:54:07,063 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:07,063 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f21c565 to 127.0.0.1:57046 2023-11-22 10:54:07,063 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:07,064 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:07,064 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4201d6a9 to 127.0.0.1:57046 2023-11-22 10:54:07,064 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:07,066 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,066 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a empty. 2023-11-22 10:54:07,067 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,067 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-22 10:54:07,075 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:07,077 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => dce3abe0feb2483bda35ed5e7c943d4a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:07,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-22 10:54:07,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing dce3abe0feb2483bda35ed5e7c943d4a, disabling compactions & flushes 2023-11-22 10:54:07,483 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. after waiting 0 ms 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,483 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,483 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:07,485 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:07,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650447486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650447486"}]},"ts":"1700650447486"} 2023-11-22 10:54:07,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:54:07,489 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:07,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650447489"}]},"ts":"1700650447489"} 2023-11-22 10:54:07,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-22 10:54:07,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=dce3abe0feb2483bda35ed5e7c943d4a, ASSIGN}] 2023-11-22 10:54:07,495 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=dce3abe0feb2483bda35ed5e7c943d4a, ASSIGN 2023-11-22 10:54:07,495 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=dce3abe0feb2483bda35ed5e7c943d4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:07,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=dce3abe0feb2483bda35ed5e7c943d4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:07,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650447646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650447646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650447646"}]},"ts":"1700650447646"} 2023-11-22 10:54:07,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure dce3abe0feb2483bda35ed5e7c943d4a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:07,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-22 10:54:07,800 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:07,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dce3abe0feb2483bda35ed5e7c943d4a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:07,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:07,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,805 INFO [StoreOpener-dce3abe0feb2483bda35ed5e7c943d4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,806 DEBUG [StoreOpener-dce3abe0feb2483bda35ed5e7c943d4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:07,807 DEBUG [StoreOpener-dce3abe0feb2483bda35ed5e7c943d4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:07,807 INFO [StoreOpener-dce3abe0feb2483bda35ed5e7c943d4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dce3abe0feb2483bda35ed5e7c943d4a columnFamilyName family1 2023-11-22 10:54:07,808 INFO [StoreOpener-dce3abe0feb2483bda35ed5e7c943d4a-1] regionserver.HStore(310): Store=dce3abe0feb2483bda35ed5e7c943d4a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:07,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:54:07,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:07,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dce3abe0feb2483bda35ed5e7c943d4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66543375, jitterRate=-0.008426442742347717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:07,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:07,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a., pid=37, masterSystemTime=1700650447800 2023-11-22 10:54:07,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:07,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=dce3abe0feb2483bda35ed5e7c943d4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:07,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700650447817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650447817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650447817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650447817"}]},"ts":"1700650447817"} 2023-11-22 10:54:07,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=37, resume processing ppid=36 2023-11-22 10:54:07,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure dce3abe0feb2483bda35ed5e7c943d4a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 171 msec 2023-11-22 10:54:07,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=36, resume processing ppid=35 2023-11-22 10:54:07,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=dce3abe0feb2483bda35ed5e7c943d4a, ASSIGN in 328 msec 2023-11-22 10:54:07,823 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:54:07,823 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650447823"}]},"ts":"1700650447823"} 2023-11-22 10:54:07,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-22 10:54:07,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:54:07,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 789 msec 2023-11-22 10:54:08,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-22 10:54:08,169 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-22 10:54:08,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:08,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,200 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:08,200 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:08,200 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:08,200 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:08,201 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,201 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,204 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:08,204 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:08,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:08,204 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:08,204 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:08,206 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:08,206 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:08,206 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:08,206 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:08,206 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:08,206 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:08,206 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:08,207 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:54:08,213 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/.tmp/family1/e9c13fdca2714817b6673cc96dcc2b6e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/e9c13fdca2714817b6673cc96dcc2b6e 2023-11-22 10:54:08,222 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 364f7661920cd9dfa5edfb250e4fabe6/family1 of 364f7661920cd9dfa5edfb250e4fabe6 into e9c13fdca2714817b6673cc96dcc2b6e(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:54:08,222 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:54:08,222 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700650446980; duration=1sec 2023-11-22 10:54:08,222 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:08,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_] to archive 2023-11-22 10:54:08,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:08,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/10620575e2b047a6938b82ac5af02286 2023-11-22 10:54:08,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/f50d8ae20356476fbaf53ea9c2abc39c 2023-11-22 10:54:08,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/family1/d82db065831a4296a7295018d1201800_SeqId_12_ 2023-11-22 10:54:08,639 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113082ede46dbd4c4492b6c0149375a301d2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113082ede46dbd4c4492b6c0149375a301d2 2023-11-22 10:54:08,725 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:54:09,043 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/4b53a20062cd4586ab9385f49e7150a5 2023-11-22 10:54:09,048 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/4b53a20062cd4586ab9385f49e7150a5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5 2023-11-22 10:54:09,053 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-22 10:54:09,054 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 847ms, sequenceid=5, compaction requested=false 2023-11-22 10:54:09,054 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:09,055 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:09,055 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:09,057 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:09,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:09,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ad96a6f[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:09,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:09,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,060 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:09,060 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,060 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:09,062 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:09,062 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:09,062 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,062 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:09,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:09,064 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:09,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:09,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:09,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,064 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:09,072 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,072 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:09,072 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,073 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,074 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:09,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:09,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:54:09,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:09,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:09,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:09,076 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:09,076 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,077 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,177 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:09,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:09,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:09,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:09,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,184 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:09,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:09,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:09,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:09,184 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,185 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,186 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,186 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:09,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:09,186 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:09,186 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,187 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:09,188 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:09,188 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:09,188 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:54:09,601 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c52e4ea90cd543f69f1f47e7fdbf2aac to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128c52e4ea90cd543f69f1f47e7fdbf2aac 2023-11-22 10:54:10,007 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/d43cb7dba45648319efeccc3b19b905c 2023-11-22 10:54:10,011 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/d43cb7dba45648319efeccc3b19b905c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c 2023-11-22 10:54:10,015 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:54:10,016 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 828ms, sequenceid=9, compaction requested=false 2023-11-22 10:54:10,017 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:10,017 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:10,017 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:10,017 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:10,017 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,017 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:10,017 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:10,028 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,028 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:10,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:10,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@586680f7[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:10,030 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:10,030 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,038 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:10,039 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,039 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:10,043 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:10,043 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,043 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:10,043 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:10,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:10,046 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:10,046 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:10,046 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:10,046 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,046 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:10,049 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,049 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,049 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,050 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,051 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:10,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:10,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:54:10,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:10,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:10,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:10,060 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,060 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:10,060 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:10,060 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,160 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:10,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:10,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:10,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:10,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,166 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:10,166 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:10,166 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:10,166 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:10,166 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,166 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,168 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,168 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:10,168 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,168 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:10,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,169 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:10,169 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:10,170 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:10,170 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:10,170 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:10,170 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:10,170 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:10,170 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:10,582 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f6693b2ef0a846c2979f1b0e862c0739 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6693b2ef0a846c2979f1b0e862c0739 2023-11-22 10:54:10,988 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/84420d49db45482eace33fc8a370ed1e 2023-11-22 10:54:10,993 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/84420d49db45482eace33fc8a370ed1e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e 2023-11-22 10:54:10,996 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e, entries=1, sequenceid=13, filesize=4.9 K 2023-11-22 10:54:10,997 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=13, compaction requested=true 2023-11-22 10:54:10,997 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:10,997 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:10,997 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:10,999 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:10,999 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c727a28[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:11,001 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:11,001 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,003 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,003 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:11,003 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:11,003 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:11,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:11,005 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:11,007 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:11,007 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:11,007 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:11,008 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,008 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:11,009 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,009 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,009 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:11,010 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,011 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,013 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,013 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,013 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:11,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:11,013 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,013 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:11,014 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:11,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:11,014 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:11,114 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:11,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:11,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:11,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:11,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,120 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:11,121 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:11,121 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:11,121 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:11,121 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,121 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,124 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,124 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:11,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:11,124 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,124 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,125 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:11,125 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:11,125 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:11,125 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:11,125 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:11,126 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:11,126 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:11,126 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:11,538 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056e196e361ea14522bf04429bf2f0db4b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e196e361ea14522bf04429bf2f0db4b 2023-11-22 10:54:11,943 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/c8169663e11249bcbcc325f591872ca1 2023-11-22 10:54:11,948 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/c8169663e11249bcbcc325f591872ca1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1 2023-11-22 10:54:11,952 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1, entries=1, sequenceid=17, filesize=4.9 K 2023-11-22 10:54:11,953 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=17, compaction requested=true 2023-11-22 10:54:11,953 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:11,953 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:11,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:11,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:11,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:11,953 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:11,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,955 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:11,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@469db523[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:11,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:11,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,958 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:11,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:11,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:11,958 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,958 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:11,959 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:11,959 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,959 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,959 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:11,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:11,962 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:11,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:11,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:11,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,962 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:11,964 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,964 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,964 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:11,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:11,965 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,966 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,968 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,968 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:11,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:11,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:11,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:11,969 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:11,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:11,969 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:11,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:12,069 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:12,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:12,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:12,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,075 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:12,075 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:12,075 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:12,075 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:12,076 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,076 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,077 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,077 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:12,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:12,077 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,077 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:12,079 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:12,079 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:12,079 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:12,079 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:12,491 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285fca457890be413c8ea3661c3435b91f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285fca457890be413c8ea3661c3435b91f 2023-11-22 10:54:12,896 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/4ebeacc172704f6696547cfd80257fc7 2023-11-22 10:54:12,901 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/4ebeacc172704f6696547cfd80257fc7 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7 2023-11-22 10:54:12,905 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7, entries=1, sequenceid=21, filesize=4.9 K 2023-11-22 10:54:12,906 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=21, compaction requested=true 2023-11-22 10:54:12,906 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:12,906 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:12,906 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:12,908 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,908 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:12,909 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,909 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:12,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:12,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4716358d[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:12,911 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:12,911 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,913 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:12,913 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,913 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:12,914 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:12,914 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,914 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:12,914 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:12,917 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:12,917 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:12,917 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:12,917 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,917 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:12,921 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,921 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,921 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:12,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:12,922 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,923 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:12,926 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:12,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:12,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:54:12,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:12,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:12,926 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:12,927 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,927 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,927 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:12,927 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:12,927 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:12,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:12,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:13,027 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:13,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:13,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:13,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:13,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,033 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:13,033 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:13,033 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:13,033 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:13,034 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,034 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,035 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,035 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:13,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:13,035 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,035 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,036 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:13,036 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:13,036 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:13,037 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:13,037 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:13,037 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:13,037 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:13,037 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:13,449 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311ebfb10c3ec44678954cf11e9f0f4409 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebfb10c3ec44678954cf11e9f0f4409 2023-11-22 10:54:13,855 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/2b5aada2a1484bde90d7954038010106 2023-11-22 10:54:13,859 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/2b5aada2a1484bde90d7954038010106 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106 2023-11-22 10:54:13,863 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106, entries=1, sequenceid=25, filesize=4.9 K 2023-11-22 10:54:13,864 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=25, compaction requested=true 2023-11-22 10:54:13,864 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:13,864 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:13,864 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:13,864 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:13,864 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,864 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:13,864 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:13,867 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,867 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:13,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:13,867 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,867 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:13,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:13,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:13,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b1b74a0[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:13,869 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:13,869 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,870 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:13,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:13,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:13,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:13,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:13,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:13,872 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:13,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:13,874 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:13,874 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:13,874 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:13,874 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,874 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:13,876 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,876 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:13,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:13,876 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:13,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:13,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:13,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:13,877 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:13,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,878 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:13,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,881 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:13,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:54:13,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:13,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:13,882 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:13,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:13,882 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:13,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:13,982 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:13,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:13,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:13,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:13,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,989 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:13,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:13,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:13,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:13,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,989 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,991 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,991 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:13,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:13,991 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:13,991 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,992 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:13,993 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:13,993 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:13,993 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:14,405 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013722efd9d2574ceab36fe5e4425fce8c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013722efd9d2574ceab36fe5e4425fce8c 2023-11-22 10:54:14,810 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/36c2f921f7b34c7e8163261922757a71 2023-11-22 10:54:14,815 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/36c2f921f7b34c7e8163261922757a71 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71 2023-11-22 10:54:14,819 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71, entries=1, sequenceid=29, filesize=4.9 K 2023-11-22 10:54:14,820 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=29, compaction requested=true 2023-11-22 10:54:14,820 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:14,820 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:14,820 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:14,820 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:14,820 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,820 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:14,820 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:14,823 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,823 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:14,823 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,823 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:14,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:14,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1487f8d1[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:14,825 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:14,825 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,826 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,826 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:14,826 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:14,826 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:14,826 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,826 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:14,827 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:14,827 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:14,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:14,830 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:14,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:14,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:14,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,830 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:14,831 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,831 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:14,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,832 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:14,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:14,832 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,833 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:14,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:14,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:14,837 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,837 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:14,838 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:14,938 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:14,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:14,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:14,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:14,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,944 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,946 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,946 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:14,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:14,946 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:14,946 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:14,947 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:14,948 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:14,948 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:15,360 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103926d2510f27e4de0b5f647a516298d74 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103926d2510f27e4de0b5f647a516298d74 2023-11-22 10:54:15,765 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/44dfbe2d8790422682ebb4474f1c0dc7 2023-11-22 10:54:15,770 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/44dfbe2d8790422682ebb4474f1c0dc7 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7 2023-11-22 10:54:15,773 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7, entries=1, sequenceid=33, filesize=4.9 K 2023-11-22 10:54:15,774 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 826ms, sequenceid=33, compaction requested=true 2023-11-22 10:54:15,774 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:15,774 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:15,779 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:15,780 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,780 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f9873cf[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:15,781 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:15,781 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,783 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:15,783 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,783 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:15,786 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:15,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:15,788 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:15,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:15,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:15,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,788 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:15,791 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,791 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:15,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,791 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:15,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:15,792 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,793 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:15,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:15,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:15,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:15,796 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:15,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:15,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,797 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,797 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,797 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:15,797 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:15,797 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:15,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:15,897 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:15,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:15,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,904 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:15,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:15,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:15,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:15,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,906 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:15,906 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:15,906 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:15,906 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:15,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:15,908 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:15,908 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:16,321 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907116c30f6f0004eed8f9fc980127a0dd9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907116c30f6f0004eed8f9fc980127a0dd9 2023-11-22 10:54:16,726 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/80c13db4068b47d5b69cfc5bfdf22b3c 2023-11-22 10:54:16,731 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/80c13db4068b47d5b69cfc5bfdf22b3c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c 2023-11-22 10:54:16,735 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c, entries=1, sequenceid=37, filesize=4.9 K 2023-11-22 10:54:16,735 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 827ms, sequenceid=37, compaction requested=true 2023-11-22 10:54:16,736 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:16,736 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:16,738 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:16,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495483ec[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:16,740 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:16,740 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,742 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:16,742 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,742 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:16,743 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:16,743 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,743 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:16,743 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:16,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:16,746 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:16,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:16,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:16,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,746 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:16,747 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,747 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:16,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,747 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:16,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:16,748 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,749 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:16,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:16,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:16,752 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:16,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:16,852 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:16,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:16,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,859 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:16,859 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:16,859 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-22 10:54:16,859 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-22 10:54:16,859 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,859 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,862 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,863 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-22 10:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-22 10:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-22 10:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:16,863 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:16,863 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. started... 2023-11-22 10:54:16,863 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dce3abe0feb2483bda35ed5e7c943d4a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:17,276 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120640372dd48be42b19f9048aaecfbc5a6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120640372dd48be42b19f9048aaecfbc5a6 2023-11-22 10:54:17,681 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/1910fccfeb964fc389537c19c2c09957 2023-11-22 10:54:17,686 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/1910fccfeb964fc389537c19c2c09957 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957 2023-11-22 10:54:17,690 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957, entries=1, sequenceid=41, filesize=4.9 K 2023-11-22 10:54:17,691 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dce3abe0feb2483bda35ed5e7c943d4a in 828ms, sequenceid=41, compaction requested=true 2023-11-22 10:54:17,691 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:17,691 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:17,691 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:17,692 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:17,692 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,692 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-22 10:54:17,692 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-22 10:54:17,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,693 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-22 10:54:17,695 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-22 10:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@399a5012[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:17,695 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,696 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,697 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-22 10:54:17,697 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-22 10:54:17,697 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:17,697 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,697 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:17,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-22 10:54:17,698 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:17,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-22 10:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:54:17,700 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-22 10:54:17,700 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:17,700 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:17,701 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,701 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:17,703 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,703 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:17,703 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:17,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:17,703 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,705 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:17,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-22 10:54:17,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:17,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,709 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:17,709 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:17,810 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:17,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:17,812 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-22 10:54:17,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:17,814 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:17,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:17,815 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651057815 2023-11-22 10:54:17,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:17,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-22 10:54:17,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:17,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x73d3e8f3 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:17,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a4b6985, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:17,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,667 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038ad8cfe624f44113a0e30f8392855cbf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038ad8cfe624f44113a0e30f8392855cbf 2023-11-22 10:54:18,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:18,681 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:18,682 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:18,688 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:18,689 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:18,697 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e3377b71e55d4bb6907e7bdb26b01ec3 first=Optional[r3] last=Optional[r6] 2023-11-22 10:54:18,697 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e3377b71e55d4bb6907e7bdb26b01ec3}] 2023-11-22 10:54:18,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e3377b71e55d4bb6907e7bdb26b01ec3 for inclusion in dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-22 10:54:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:18,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e3377b71e55d4bb6907e7bdb26b01ec3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d5tpg4u22ed35i466jqkfm4dg2l0vmniqu00sedq0f03mljnl56kt3hb9e4vh98q/family1/e3377b71e55d4bb6907e7bdb26b01ec3 2023-11-22 10:54:18,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d5tpg4u22ed35i466jqkfm4dg2l0vmniqu00sedq0f03mljnl56kt3hb9e4vh98q/family1/e3377b71e55d4bb6907e7bdb26b01ec3 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_ 2023-11-22 10:54:18,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d5tpg4u22ed35i466jqkfm4dg2l0vmniqu00sedq0f03mljnl56kt3hb9e4vh98q/family1/e3377b71e55d4bb6907e7bdb26b01ec3 into dce3abe0feb2483bda35ed5e7c943d4a/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_ - updating store file list. 2023-11-22 10:54:18,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_ into dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:18,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d5tpg4u22ed35i466jqkfm4dg2l0vmniqu00sedq0f03mljnl56kt3hb9e4vh98q/family1/e3377b71e55d4bb6907e7bdb26b01ec3 into dce3abe0feb2483bda35ed5e7c943d4a/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_) 2023-11-22 10:54:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d5tpg4u22ed35i466jqkfm4dg2l0vmniqu00sedq0f03mljnl56kt3hb9e4vh98q/family1/e3377b71e55d4bb6907e7bdb26b01ec3 2023-11-22 10:54:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:54:18,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:54:18,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): dce3abe0feb2483bda35ed5e7c943d4a/family1 is initiating minor compaction 2023-11-22 10:54:18,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@27c2f674; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:18,714 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dce3abe0feb2483bda35ed5e7c943d4a/family1 in testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:18,714 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp, totalSize=50.0 K 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d43cb7dba45648319efeccc3b19b905c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 84420d49db45482eace33fc8a370ed1e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting c8169663e11249bcbcc325f591872ca1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 4ebeacc172704f6696547cfd80257fc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 2b5aada2a1484bde90d7954038010106, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 36c2f921f7b34c7e8163261922757a71, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:54:18,714 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 44dfbe2d8790422682ebb4474f1c0dc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:54:18,715 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 80c13db4068b47d5b69cfc5bfdf22b3c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:54:18,715 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 1910fccfeb964fc389537c19c2c09957, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:54:18,715 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting df865a70227e4931ac3a8282121817a3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:54:18,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:18,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:18,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285fca457890be413c8ea3661c3435b91f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285fca457890be413c8ea3661c3435b91f 2023-11-22 10:54:18,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebfb10c3ec44678954cf11e9f0f4409 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebfb10c3ec44678954cf11e9f0f4409 2023-11-22 10:54:18,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013722efd9d2574ceab36fe5e4425fce8c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013722efd9d2574ceab36fe5e4425fce8c 2023-11-22 10:54:18,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103926d2510f27e4de0b5f647a516298d74 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103926d2510f27e4de0b5f647a516298d74 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-22 10:54:18,722 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:18,743 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): dce3abe0feb2483bda35ed5e7c943d4a#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:19,561 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/deb8d0f061c2495f8c015d67a85a6b37 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/deb8d0f061c2495f8c015d67a85a6b37 2023-11-22 10:54:19,564 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056874c41ac15143e6b9a2ab806acfc966 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056874c41ac15143e6b9a2ab806acfc966 2023-11-22 10:54:19,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:19,567 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in dce3abe0feb2483bda35ed5e7c943d4a/family1 of dce3abe0feb2483bda35ed5e7c943d4a into deb8d0f061c2495f8c015d67a85a6b37(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:19,567 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:19,567 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700650458714; duration=0sec 2023-11-22 10:54:19,567 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:19,590 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/222e132370a246118e638b0d6cd8275b first=Optional[r00] last=Optional[r2] 2023-11-22 10:54:19,591 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/222e132370a246118e638b0d6cd8275b}] 2023-11-22 10:54:19,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/222e132370a246118e638b0d6cd8275b for inclusion in dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:19,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-22 10:54:19,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:19,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:19,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/222e132370a246118e638b0d6cd8275b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ilqetqn3elmi3k1946dua3lufo85do5bcig7qhguk8p4a07qb21kfh2r1pn895vg/family1/222e132370a246118e638b0d6cd8275b 2023-11-22 10:54:19,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ilqetqn3elmi3k1946dua3lufo85do5bcig7qhguk8p4a07qb21kfh2r1pn895vg/family1/222e132370a246118e638b0d6cd8275b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_ 2023-11-22 10:54:19,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ilqetqn3elmi3k1946dua3lufo85do5bcig7qhguk8p4a07qb21kfh2r1pn895vg/family1/222e132370a246118e638b0d6cd8275b into dce3abe0feb2483bda35ed5e7c943d4a/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_ - updating store file list. 2023-11-22 10:54:19,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_ into dce3abe0feb2483bda35ed5e7c943d4a/family1 2023-11-22 10:54:19,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ilqetqn3elmi3k1946dua3lufo85do5bcig7qhguk8p4a07qb21kfh2r1pn895vg/family1/222e132370a246118e638b0d6cd8275b into dce3abe0feb2483bda35ed5e7c943d4a/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_) 2023-11-22 10:54:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ilqetqn3elmi3k1946dua3lufo85do5bcig7qhguk8p4a07qb21kfh2r1pn895vg/family1/222e132370a246118e638b0d6cd8275b 2023-11-22 10:54:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:54:19,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:54:19,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): dce3abe0feb2483bda35ed5e7c943d4a/family1 is initiating minor compaction (all files) 2023-11-22 10:54:19,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6bfa798f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:19,604 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dce3abe0feb2483bda35ed5e7c943d4a/family1 in testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:54:19,604 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/deb8d0f061c2495f8c015d67a85a6b37, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp, totalSize=337.0 K 2023-11-22 10:54:19,605 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 4b53a20062cd4586ab9385f49e7150a5, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:54:19,605 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting deb8d0f061c2495f8c015d67a85a6b37, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:54:19,606 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824734 2023-11-22 10:54:19,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:19,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:19,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113082ede46dbd4c4492b6c0149375a301d2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113082ede46dbd4c4492b6c0149375a301d2 2023-11-22 10:54:19,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6693b2ef0a846c2979f1b0e862c0739 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6693b2ef0a846c2979f1b0e862c0739 2023-11-22 10:54:19,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e196e361ea14522bf04429bf2f0db4b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e196e361ea14522bf04429bf2f0db4b 2023-11-22 10:54:19,610 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-22 10:54:19,611 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-22 10:54:19,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-22 10:54:19,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-22 10:54:19,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:19,612 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:54:19,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.7990 sec 2023-11-22 10:54:19,623 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): dce3abe0feb2483bda35ed5e7c943d4a#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:19,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_] to archive 2023-11-22 10:54:19,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:19,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d43cb7dba45648319efeccc3b19b905c 2023-11-22 10:54:19,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/84420d49db45482eace33fc8a370ed1e 2023-11-22 10:54:19,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/c8169663e11249bcbcc325f591872ca1 2023-11-22 10:54:19,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4ebeacc172704f6696547cfd80257fc7 2023-11-22 10:54:19,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/2b5aada2a1484bde90d7954038010106 2023-11-22 10:54:19,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/36c2f921f7b34c7e8163261922757a71 2023-11-22 10:54:19,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/44dfbe2d8790422682ebb4474f1c0dc7 2023-11-22 10:54:19,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/80c13db4068b47d5b69cfc5bfdf22b3c 2023-11-22 10:54:19,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/1910fccfeb964fc389537c19c2c09957 2023-11-22 10:54:19,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/df865a70227e4931ac3a8282121817a3_SeqId_44_ 2023-11-22 10:54:19,716 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 260), OpenFileDescriptor=637 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 250), ProcessCount=171 (was 171), AvailableMemoryMB=9591 (was 9631) 2023-11-22 10:54:19,729 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=171, AvailableMemoryMB=9591 2023-11-22 10:54:19,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:54:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:19,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:19,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-22 10:54:19,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:19,736 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:19,736 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 empty. 2023-11-22 10:54:19,737 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:19,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-22 10:54:19,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:20,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:20,146 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:20,147 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c07847601fb4586ffd51842a7561949, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 3c07847601fb4586ffd51842a7561949, disabling compactions & flushes 2023-11-22 10:54:20,553 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. after waiting 0 ms 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,553 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:20,555 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:20,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650460556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650460556"}]},"ts":"1700650460556"} 2023-11-22 10:54:20,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:54:20,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:20,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650460559"}]},"ts":"1700650460559"} 2023-11-22 10:54:20,560 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-22 10:54:20,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, ASSIGN}] 2023-11-22 10:54:20,565 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, ASSIGN 2023-11-22 10:54:20,566 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:20,717 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:20,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650460717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650460717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650460717"}]},"ts":"1700650460717"} 2023-11-22 10:54:20,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:20,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:20,843 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/.tmp/family1/01eadae187eb496f8e261a591bb4fc57 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/01eadae187eb496f8e261a591bb4fc57 2023-11-22 10:54:20,847 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in dce3abe0feb2483bda35ed5e7c943d4a/family1 of dce3abe0feb2483bda35ed5e7c943d4a into 01eadae187eb496f8e261a591bb4fc57(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:54:20,848 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:54:20,848 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700650459604; duration=1sec 2023-11-22 10:54:20,848 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:20,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/deb8d0f061c2495f8c015d67a85a6b37, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_] to archive 2023-11-22 10:54:20,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:20,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/4b53a20062cd4586ab9385f49e7150a5 2023-11-22 10:54:20,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/deb8d0f061c2495f8c015d67a85a6b37 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/deb8d0f061c2495f8c015d67a85a6b37 2023-11-22 10:54:20,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/family1/d58e3a98fad64aec8fe93f26eaa0cf01_SeqId_47_ 2023-11-22 10:54:20,870 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:20,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c07847601fb4586ffd51842a7561949, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,874 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,875 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:20,876 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:20,876 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c07847601fb4586ffd51842a7561949 columnFamilyName family1 2023-11-22 10:54:20,877 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(310): Store=3c07847601fb4586ffd51842a7561949/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:20,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:20,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:20,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c07847601fb4586ffd51842a7561949; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66973938, jitterRate=-0.002010554075241089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:20,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:20,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., pid=41, masterSystemTime=1700650460870 2023-11-22 10:54:20,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:20,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:20,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650460885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650460885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650460885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650460885"}]},"ts":"1700650460885"} 2023-11-22 10:54:20,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=41, resume processing ppid=40 2023-11-22 10:54:20,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831 in 168 msec 2023-11-22 10:54:20,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=40, resume processing ppid=39 2023-11-22 10:54:20,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, ASSIGN in 324 msec 2023-11-22 10:54:20,891 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:54:20,891 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650460891"}]},"ts":"1700650460891"} 2023-11-22 10:54:20,892 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-22 10:54:20,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:54:20,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1620 sec 2023-11-22 10:54:21,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-22 10:54:21,840 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-22 10:54:21,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:21,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,866 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:21,866 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:21,866 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:21,867 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:21,867 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,867 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,869 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:21,869 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:21,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:21,869 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:21,869 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,870 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:21,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:21,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:21,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:21,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:21,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:21,870 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:21,871 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:21,871 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:54:22,290 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113077fce53027624fb99bbfd2c2471e87fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113077fce53027624fb99bbfd2c2471e87fc 2023-11-22 10:54:22,580 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:22,694 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/f6b3bf0ecbd14b5babbc5e44753c2de7 2023-11-22 10:54:22,699 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/f6b3bf0ecbd14b5babbc5e44753c2de7 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7 2023-11-22 10:54:22,703 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-22 10:54:22,704 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 833ms, sequenceid=5, compaction requested=false 2023-11-22 10:54:22,704 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:22,705 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:22,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:22,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:22,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:22,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:22,707 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,707 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:22,708 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:22,708 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:22,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:22,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12707680[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:22,709 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:22,709 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,711 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:22,711 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:22,711 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:22,711 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,711 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:22,714 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,714 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:22,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,714 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:22,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:22,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:22,714 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:22,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:22,716 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:22,717 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:22,717 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:22,717 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,717 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:22,718 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,718 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:22,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,718 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:22,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:22,719 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,720 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,722 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,723 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:22,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:22,723 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:22,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:22,823 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:22,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:22,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:22,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:22,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,830 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:22,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:22,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:22,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:22,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,830 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,831 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,831 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:22,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:22,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:22,832 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:22,832 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:22,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:22,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,833 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:22,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:22,833 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:22,833 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:22,833 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:54:23,246 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ac4af6f10c2d44789ad82f842eb2ed5e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ac4af6f10c2d44789ad82f842eb2ed5e 2023-11-22 10:54:23,652 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/ef6e80994ee4464ebc338a97f06f48bf 2023-11-22 10:54:23,657 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/ef6e80994ee4464ebc338a97f06f48bf as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf 2023-11-22 10:54:23,660 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:54:23,661 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 828ms, sequenceid=9, compaction requested=false 2023-11-22 10:54:23,661 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:23,661 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:23,662 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:23,663 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,663 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:23,664 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,664 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e0a790a[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:23,665 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:23,665 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,667 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:23,667 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:23,667 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:23,667 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,667 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:23,669 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:23,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:23,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:23,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:23,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:23,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:23,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:23,672 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:23,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:23,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:23,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,672 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:23,673 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,673 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:23,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:23,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,673 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:23,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:23,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:23,674 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:23,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,675 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:23,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:23,681 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:23,681 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:23,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:23,781 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:23,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:23,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:23,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:23,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,788 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:23,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:23,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:23,788 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:23,789 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,789 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,790 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:23,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:23,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:23,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:23,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:23,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:23,792 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:23,792 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:23,792 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:23,792 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:24,203 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011aeabd9bcef2440c97a3ea9b22e95f32 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011aeabd9bcef2440c97a3ea9b22e95f32 2023-11-22 10:54:24,609 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/5c8ea11845864c2a9b57e08907fc9ed1 2023-11-22 10:54:24,615 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/5c8ea11845864c2a9b57e08907fc9ed1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1 2023-11-22 10:54:24,619 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1, entries=1, sequenceid=13, filesize=5.0 K 2023-11-22 10:54:24,620 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 828ms, sequenceid=13, compaction requested=true 2023-11-22 10:54:24,620 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:24,620 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:24,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:24,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:24,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:24,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:24,622 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,622 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:24,623 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,623 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32cdcc4[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:24,624 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:24,624 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,625 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,626 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:24,626 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:24,626 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:24,626 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,626 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:24,627 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:24,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:24,627 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:24,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:24,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:24,630 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:24,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:24,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:24,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,630 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:24,633 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,633 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:24,633 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:24,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:24,633 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,635 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:24,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:24,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:24,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:24,637 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:24,637 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:24,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:24,737 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:24,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:24,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:24,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:24,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,744 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:24,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:24,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:24,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:24,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:24,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:24,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:24,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:24,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:24,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:24,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:24,748 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:25,162 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205da6e96e3d4f641dcacfbd26d5cf058ea to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205da6e96e3d4f641dcacfbd26d5cf058ea 2023-11-22 10:54:25,578 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/100c465d23fa487580b8e95eeea2d33d 2023-11-22 10:54:25,583 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/100c465d23fa487580b8e95eeea2d33d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d 2023-11-22 10:54:25,586 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d, entries=1, sequenceid=17, filesize=5.0 K 2023-11-22 10:54:25,587 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 840ms, sequenceid=17, compaction requested=true 2023-11-22 10:54:25,587 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:25,587 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:25,589 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,589 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:25,590 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,590 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:25,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:25,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685d0673[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:25,591 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:25,591 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,594 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,594 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:25,594 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:25,594 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:25,594 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,594 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:25,595 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:25,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:25,598 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:25,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:25,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:25,598 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,598 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:25,600 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,600 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,600 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:25,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:25,601 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,602 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:25,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:25,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-22 10:54:25,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:25,605 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:25,706 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:25,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:25,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:25,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:25,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,711 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:25,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:25,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:25,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:25,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,718 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:25,718 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:25,719 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:25,719 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,720 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:25,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:25,720 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:25,720 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:25,720 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:26,132 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286f08405239574a038a5a77354025bb5b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286f08405239574a038a5a77354025bb5b 2023-11-22 10:54:26,402 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:54:26,537 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/840f1cd3f83b415eb5dcfd143336a826 2023-11-22 10:54:26,542 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/840f1cd3f83b415eb5dcfd143336a826 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826 2023-11-22 10:54:26,546 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826, entries=1, sequenceid=21, filesize=5.0 K 2023-11-22 10:54:26,547 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 827ms, sequenceid=21, compaction requested=true 2023-11-22 10:54:26,547 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:26,547 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:26,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:26,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:26,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:26,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:26,549 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,549 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:26,550 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,550 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:26,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:26,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:26,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7908b98e[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:26,551 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:26,551 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,553 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,553 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:26,553 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:26,553 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:26,553 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,553 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:26,555 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,555 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:26,555 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:26,555 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:26,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:26,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:26,558 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:26,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:26,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:26,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,558 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:26,560 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,560 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,560 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:26,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:26,560 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,562 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-22 10:54:26,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:26,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:26,564 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:26,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:26,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:26,565 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:26,565 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:26,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:26,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:26,665 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:26,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:26,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:26,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:26,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,672 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:26,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:26,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:26,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:26,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,674 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:26,674 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:26,674 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:26,674 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:26,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:26,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:26,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:26,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:26,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:26,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:26,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:26,675 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:26,675 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:26,676 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:27,088 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e9edeadc30334453a7f11661f0053cfc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9edeadc30334453a7f11661f0053cfc 2023-11-22 10:54:27,494 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/5fa274951fe84d1db80189b8db8c3bb6 2023-11-22 10:54:27,499 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/5fa274951fe84d1db80189b8db8c3bb6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6 2023-11-22 10:54:27,503 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6, entries=1, sequenceid=25, filesize=5.0 K 2023-11-22 10:54:27,504 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 828ms, sequenceid=25, compaction requested=true 2023-11-22 10:54:27,504 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:27,504 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:27,504 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:27,504 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:27,504 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,504 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:27,504 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:27,510 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:27,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:27,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:27,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:27,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44f74d8c[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:27,512 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:27,512 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,513 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:27,513 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,513 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:27,514 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:27,514 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,514 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:27,514 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:27,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:27,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:27,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:27,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:27,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:27,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:27,517 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:27,517 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:27,517 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:27,517 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,517 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:27,518 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,518 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:27,518 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:27,519 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:27,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:27,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:27,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,524 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,524 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:27,624 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:27,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:27,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:27,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:27,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,630 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:27,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:27,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:27,630 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:27,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,632 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:27,632 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:27,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:27,633 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:27,633 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:27,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:27,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:27,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:27,634 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:27,634 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:27,634 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:28,045 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101abecba21f1b14a518c7ff6759b7b602b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abecba21f1b14a518c7ff6759b7b602b 2023-11-22 10:54:28,451 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/4b342dd5c9f849a8bb89ad6c3e94cda2 2023-11-22 10:54:28,455 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/4b342dd5c9f849a8bb89ad6c3e94cda2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2 2023-11-22 10:54:28,459 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2, entries=1, sequenceid=29, filesize=5.0 K 2023-11-22 10:54:28,460 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 826ms, sequenceid=29, compaction requested=true 2023-11-22 10:54:28,460 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:28,460 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:28,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:28,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:28,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2158632a[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:28,464 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:28,464 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,465 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:28,465 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,465 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:28,470 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:28,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:28,473 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:28,473 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:28,473 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:28,473 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,473 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:28,474 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,474 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,474 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:28,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:28,475 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,476 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,478 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:28,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:28,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:28,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:28,479 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:28,478 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,479 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:28,579 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:28,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:28,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:28,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:28,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,585 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:28,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:28,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:28,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:28,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:28,586 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:28,587 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:28,587 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,588 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:28,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:28,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:28,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:28,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:28,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:28,588 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:28,588 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:28,588 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:28,588 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:29,000 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103efee29327d964bd5a1891d76cb866534 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103efee29327d964bd5a1891d76cb866534 2023-11-22 10:54:29,405 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/50bcb64d0dee468da356ca77ef7439c1 2023-11-22 10:54:29,410 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/50bcb64d0dee468da356ca77ef7439c1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1 2023-11-22 10:54:29,415 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1, entries=1, sequenceid=33, filesize=5.0 K 2023-11-22 10:54:29,415 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 827ms, sequenceid=33, compaction requested=true 2023-11-22 10:54:29,415 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:29,415 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:29,418 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:29,419 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,419 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:29,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:29,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b687ec[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:29,420 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:29,420 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,421 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:29,421 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:29,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,421 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:29,423 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:29,423 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:29,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:29,426 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:29,426 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:29,426 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:29,426 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,426 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,427 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:29,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,428 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,429 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:29,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:29,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-22 10:54:29,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:29,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:29,432 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:29,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:29,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,433 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:29,533 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:29,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:29,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,539 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:29,539 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:29,539 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:29,539 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:29,539 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,539 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,541 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:29,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,542 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:29,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:29,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:29,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:29,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:29,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:29,543 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:29,543 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:29,543 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:29,954 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c58fe1cc16a34946836411d15e0ada6c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907c58fe1cc16a34946836411d15e0ada6c 2023-11-22 10:54:30,359 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/6b84d6c6da8f4a348aef571377577162 2023-11-22 10:54:30,364 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/6b84d6c6da8f4a348aef571377577162 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162 2023-11-22 10:54:30,368 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162, entries=1, sequenceid=37, filesize=5.0 K 2023-11-22 10:54:30,368 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 825ms, sequenceid=37, compaction requested=true 2023-11-22 10:54:30,369 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:30,369 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:30,371 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,371 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:30,372 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,372 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dce8e9d[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:30,373 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:30,373 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,375 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:30,375 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,375 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:30,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:30,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:30,376 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,376 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:30,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:30,379 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:30,379 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:30,379 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:30,379 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,379 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:30,380 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,380 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,380 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:30,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:30,381 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:30,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,382 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:30,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:30,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:30,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:30,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,387 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:30,387 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:30,388 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:30,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:30,488 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:30,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:30,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:30,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:30,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,494 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:30,494 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:30,494 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-22 10:54:30,494 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-22 10:54:30,495 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,495 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:30,496 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:30,496 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:30,497 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-22 10:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-22 10:54:30,498 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:30,498 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-22 10:54:30,498 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:30,498 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:30,498 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:30,498 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. started... 2023-11-22 10:54:30,498 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3c07847601fb4586ffd51842a7561949 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:30,910 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c9b1865dc1f94231a698fa3719dd1c1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c9b1865dc1f94231a698fa3719dd1c1a 2023-11-22 10:54:31,316 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/608e0415d978467ba47f30d3fcc2daf5 2023-11-22 10:54:31,320 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/608e0415d978467ba47f30d3fcc2daf5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5 2023-11-22 10:54:31,324 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5, entries=1, sequenceid=41, filesize=5.0 K 2023-11-22 10:54:31,325 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3c07847601fb4586ffd51842a7561949 in 827ms, sequenceid=41, compaction requested=true 2023-11-22 10:54:31,325 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:31,325 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:31,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:31,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:31,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-22 10:54:31,325 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-22 10:54:31,327 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:31,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:31,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-22 10:54:31,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632b2b85[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:31,328 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-22 10:54:31,328 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,330 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,330 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-22 10:54:31,330 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-22 10:54:31,330 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,330 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:31,330 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:31,333 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,333 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-22 10:54:31,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:31,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:31,333 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:31,333 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-22 10:54:31,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:31,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:31,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:31,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-22 10:54:31,336 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-22 10:54:31,336 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:31,336 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:31,336 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,336 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:31,337 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,337 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,337 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:31,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:31,338 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,339 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,341 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,341 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:31,341 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:31,342 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:31,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:31,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:31,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:31,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,342 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,442 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:31,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:31,444 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:31,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:31,446 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:31,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:31,447 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651071447 2023-11-22 10:54:31,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:31,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-22 10:54:31,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:31,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x01fe8910 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:31,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75153a1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:31,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,293 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ca495a4f28384bbf8f90449a710ca16e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ca495a4f28384bbf8f90449a710ca16e 2023-11-22 10:54:32,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:32,313 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:32,314 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:32,320 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:32,322 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:32,330 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8eb91b07827246d29fc21ea33e20cdda first=Optional[r3] last=Optional[r6] 2023-11-22 10:54:32,330 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8eb91b07827246d29fc21ea33e20cdda}] 2023-11-22 10:54:32,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8eb91b07827246d29fc21ea33e20cdda for inclusion in 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:32,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-22 10:54:32,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:32,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:32,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8eb91b07827246d29fc21ea33e20cdda to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6g342uit7edlg7ehcp5epj4p6pujv1slfnb7b8s75ibrjknasu86gga2l396ommo/family1/8eb91b07827246d29fc21ea33e20cdda 2023-11-22 10:54:32,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6g342uit7edlg7ehcp5epj4p6pujv1slfnb7b8s75ibrjknasu86gga2l396ommo/family1/8eb91b07827246d29fc21ea33e20cdda as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_ 2023-11-22 10:54:32,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6g342uit7edlg7ehcp5epj4p6pujv1slfnb7b8s75ibrjknasu86gga2l396ommo/family1/8eb91b07827246d29fc21ea33e20cdda into 3c07847601fb4586ffd51842a7561949/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_ - updating store file list. 2023-11-22 10:54:32,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_ into 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:32,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6g342uit7edlg7ehcp5epj4p6pujv1slfnb7b8s75ibrjknasu86gga2l396ommo/family1/8eb91b07827246d29fc21ea33e20cdda into 3c07847601fb4586ffd51842a7561949/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_) 2023-11-22 10:54:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6g342uit7edlg7ehcp5epj4p6pujv1slfnb7b8s75ibrjknasu86gga2l396ommo/family1/8eb91b07827246d29fc21ea33e20cdda 2023-11-22 10:54:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:54:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:54:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 3c07847601fb4586ffd51842a7561949/family1 is initiating minor compaction 2023-11-22 10:54:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@28a61e15; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:32,348 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c07847601fb4586ffd51842a7561949/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:32,348 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp, totalSize=50.4 K 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting ef6e80994ee4464ebc338a97f06f48bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5c8ea11845864c2a9b57e08907fc9ed1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 100c465d23fa487580b8e95eeea2d33d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 840f1cd3f83b415eb5dcfd143336a826, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5fa274951fe84d1db80189b8db8c3bb6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 4b342dd5c9f849a8bb89ad6c3e94cda2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:54:32,348 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 50bcb64d0dee468da356ca77ef7439c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:54:32,349 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 6b84d6c6da8f4a348aef571377577162, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:54:32,349 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 608e0415d978467ba47f30d3fcc2daf5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:54:32,349 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5e461bd37a0042baab64758c6c8866cd_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:54:32,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:32,351 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:32,352 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286f08405239574a038a5a77354025bb5b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286f08405239574a038a5a77354025bb5b 2023-11-22 10:54:32,353 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9edeadc30334453a7f11661f0053cfc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9edeadc30334453a7f11661f0053cfc 2023-11-22 10:54:32,354 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abecba21f1b14a518c7ff6759b7b602b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abecba21f1b14a518c7ff6759b7b602b 2023-11-22 10:54:32,355 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103efee29327d964bd5a1891d76cb866534 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103efee29327d964bd5a1891d76cb866534 2023-11-22 10:54:32,355 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-22 10:54:32,356 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:32,377 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3c07847601fb4586ffd51842a7561949#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:32,403 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/68579f36702c4b139e4d70d669db2536 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/68579f36702c4b139e4d70d669db2536 2023-11-22 10:54:32,407 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3c07847601fb4586ffd51842a7561949/family1 of 3c07847601fb4586ffd51842a7561949 into 68579f36702c4b139e4d70d669db2536(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:32,407 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:32,407 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700650472348; duration=0sec 2023-11-22 10:54:32,408 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:32,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_] to archive 2023-11-22 10:54:32,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:32,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/ef6e80994ee4464ebc338a97f06f48bf 2023-11-22 10:54:32,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5c8ea11845864c2a9b57e08907fc9ed1 2023-11-22 10:54:32,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/100c465d23fa487580b8e95eeea2d33d 2023-11-22 10:54:32,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/840f1cd3f83b415eb5dcfd143336a826 2023-11-22 10:54:32,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5fa274951fe84d1db80189b8db8c3bb6 2023-11-22 10:54:32,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/4b342dd5c9f849a8bb89ad6c3e94cda2 2023-11-22 10:54:32,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50bcb64d0dee468da356ca77ef7439c1 2023-11-22 10:54:32,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/6b84d6c6da8f4a348aef571377577162 2023-11-22 10:54:32,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/608e0415d978467ba47f30d3fcc2daf5 2023-11-22 10:54:32,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/5e461bd37a0042baab64758c6c8866cd_SeqId_44_ 2023-11-22 10:54:33,200 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fc765bdeef1a43a9b426417234654fe2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fc765bdeef1a43a9b426417234654fe2 2023-11-22 10:54:33,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:33,224 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3afa7b958e5f4c68a875be675e3efd3c first=Optional[r00] last=Optional[r2] 2023-11-22 10:54:33,225 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3afa7b958e5f4c68a875be675e3efd3c}] 2023-11-22 10:54:33,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3afa7b958e5f4c68a875be675e3efd3c for inclusion in 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:33,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-22 10:54:33,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:33,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3afa7b958e5f4c68a875be675e3efd3c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lo4unne4kmf2nuc296poon332r1spaa7a0o2hio8b8408p8n2k16imdhks5nh0vl/family1/3afa7b958e5f4c68a875be675e3efd3c 2023-11-22 10:54:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lo4unne4kmf2nuc296poon332r1spaa7a0o2hio8b8408p8n2k16imdhks5nh0vl/family1/3afa7b958e5f4c68a875be675e3efd3c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_ 2023-11-22 10:54:33,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lo4unne4kmf2nuc296poon332r1spaa7a0o2hio8b8408p8n2k16imdhks5nh0vl/family1/3afa7b958e5f4c68a875be675e3efd3c into 3c07847601fb4586ffd51842a7561949/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_ - updating store file list. 2023-11-22 10:54:33,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_ into 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:33,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lo4unne4kmf2nuc296poon332r1spaa7a0o2hio8b8408p8n2k16imdhks5nh0vl/family1/3afa7b958e5f4c68a875be675e3efd3c into 3c07847601fb4586ffd51842a7561949/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_) 2023-11-22 10:54:33,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lo4unne4kmf2nuc296poon332r1spaa7a0o2hio8b8408p8n2k16imdhks5nh0vl/family1/3afa7b958e5f4c68a875be675e3efd3c 2023-11-22 10:54:33,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:54:33,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:54:33,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 3c07847601fb4586ffd51842a7561949/family1 is initiating minor compaction (all files) 2023-11-22 10:54:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5574a667; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:33,240 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c07847601fb4586ffd51842a7561949/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:33,240 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/68579f36702c4b139e4d70d669db2536, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp, totalSize=390.1 K 2023-11-22 10:54:33,240 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting f6b3bf0ecbd14b5babbc5e44753c2de7, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:54:33,241 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 68579f36702c4b139e4d70d669db2536, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:54:33,241 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 50d239261fec426796a02e2f59156e19_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824734 2023-11-22 10:54:33,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:33,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:33,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113077fce53027624fb99bbfd2c2471e87fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113077fce53027624fb99bbfd2c2471e87fc 2023-11-22 10:54:33,245 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011aeabd9bcef2440c97a3ea9b22e95f32 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011aeabd9bcef2440c97a3ea9b22e95f32 2023-11-22 10:54:33,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205da6e96e3d4f641dcacfbd26d5cf058ea to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205da6e96e3d4f641dcacfbd26d5cf058ea 2023-11-22 10:54:33,246 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-22 10:54:33,246 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-22 10:54:33,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:33,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:33,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:33,248 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:33,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8030 sec 2023-11-22 10:54:33,257 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3c07847601fb4586ffd51842a7561949#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:33,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-22 10:54:33,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:33,734 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:33,735 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:33,735 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:33,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-22 10:54:33,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE}] 2023-11-22 10:54:33,740 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE 2023-11-22 10:54:33,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:33,741 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650473741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650473741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650473741"}]},"ts":"1700650473741"} 2023-11-22 10:54:33,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:33,893 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:33,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:33,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c07847601fb4586ffd51842a7561949, disabling compactions & flushes 2023-11-22 10:54:33,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,475 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/.tmp/family1/beeb69aa0a764d3fb933b24e4f081bfc as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/beeb69aa0a764d3fb933b24e4f081bfc 2023-11-22 10:54:34,479 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3c07847601fb4586ffd51842a7561949/family1 of 3c07847601fb4586ffd51842a7561949 into beeb69aa0a764d3fb933b24e4f081bfc(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:54:34,479 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:34,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,479 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700650473239; duration=1sec 2023-11-22 10:54:34,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. after waiting 0 ms 2023-11-22 10:54:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,480 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:34,481 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/68579f36702c4b139e4d70d669db2536, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_] to archive 2023-11-22 10:54:34,482 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:34,484 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/f6b3bf0ecbd14b5babbc5e44753c2de7 2023-11-22 10:54:34,485 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/68579f36702c4b139e4d70d669db2536 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/68579f36702c4b139e4d70d669db2536 2023-11-22 10:54:34,486 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/50d239261fec426796a02e2f59156e19_SeqId_47_ 2023-11-22 10:54:34,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-22 10:54:34,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:34,491 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 3c07847601fb4586ffd51842a7561949 to self. 2023-11-22 10:54:34,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=CLOSED 2023-11-22 10:54:34,493 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650474493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650474493"}]},"ts":"1700650474493"} 2023-11-22 10:54:34,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=46, resume processing ppid=45 2023-11-22 10:54:34,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831 in 752 msec 2023-11-22 10:54:34,496 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=true 2023-11-22 10:54:34,646 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:34,647 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650474646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650474646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650474646"}]},"ts":"1700650474646"} 2023-11-22 10:54:34,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:34,800 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:34,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c07847601fb4586ffd51842a7561949, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:34,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:34,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,804 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,805 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:34,805 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:34,806 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c07847601fb4586ffd51842a7561949 columnFamilyName family1 2023-11-22 10:54:34,810 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/beeb69aa0a764d3fb933b24e4f081bfc 2023-11-22 10:54:34,811 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(310): Store=3c07847601fb4586ffd51842a7561949/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:34,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:34,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c07847601fb4586ffd51842a7561949; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71891718, jitterRate=0.07127007842063904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:34,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:34,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., pid=47, masterSystemTime=1700650474800 2023-11-22 10:54:34,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:34,819 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:34,819 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650474818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650474818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650474818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650474818"}]},"ts":"1700650474818"} 2023-11-22 10:54:34,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=47, resume processing ppid=45 2023-11-22 10:54:34,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831 in 172 msec 2023-11-22 10:54:34,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=45, resume processing ppid=44 2023-11-22 10:54:34,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE in 1.0810 sec 2023-11-22 10:54:34,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=44, resume processing ppid=43 2023-11-22 10:54:34,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0850 sec 2023-11-22 10:54:34,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5020 sec 2023-11-22 10:54:34,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-22 10:54:34,829 INFO [Listener at localhost/45227] compactions.TestMobCompactor(278): alter status finished 2023-11-22 10:54:34,830 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:34,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:34,832 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:34,833 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651074833 2023-11-22 10:54:34,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:34,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:34,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-22 10:54:34,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:34,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x2bfd423b to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:34,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77e44882, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:34,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:34,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:34,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:34,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:34,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:35,671 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128da92d9d779c34b83aed4f73a4e77030e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128da92d9d779c34b83aed4f73a4e77030e 2023-11-22 10:54:35,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:35,685 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:35,686 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:35,692 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:35,693 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:35,701 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c1d150ec9c449818319537c412ed35c first=Optional[r05] last=Optional[r8] 2023-11-22 10:54:35,702 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c1d150ec9c449818319537c412ed35c}] 2023-11-22 10:54:35,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c1d150ec9c449818319537c412ed35c for inclusion in 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:35,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-22 10:54:35,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:35,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:35,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c1d150ec9c449818319537c412ed35c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m506bqi5jn2acss89t4e3apk6mk90rc5tuc6o7nf458lsp5bqqsncekb1idsetob/family1/1c1d150ec9c449818319537c412ed35c 2023-11-22 10:54:35,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m506bqi5jn2acss89t4e3apk6mk90rc5tuc6o7nf458lsp5bqqsncekb1idsetob/family1/1c1d150ec9c449818319537c412ed35c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/2cce9f0be4414c89be78ed051a00d7c5_SeqId_53_ 2023-11-22 10:54:35,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m506bqi5jn2acss89t4e3apk6mk90rc5tuc6o7nf458lsp5bqqsncekb1idsetob/family1/1c1d150ec9c449818319537c412ed35c into 3c07847601fb4586ffd51842a7561949/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/2cce9f0be4414c89be78ed051a00d7c5_SeqId_53_ - updating store file list. 2023-11-22 10:54:35,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/2cce9f0be4414c89be78ed051a00d7c5_SeqId_53_ into 3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:35,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m506bqi5jn2acss89t4e3apk6mk90rc5tuc6o7nf458lsp5bqqsncekb1idsetob/family1/1c1d150ec9c449818319537c412ed35c into 3c07847601fb4586ffd51842a7561949/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/2cce9f0be4414c89be78ed051a00d7c5_SeqId_53_) 2023-11-22 10:54:35,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m506bqi5jn2acss89t4e3apk6mk90rc5tuc6o7nf458lsp5bqqsncekb1idsetob/family1/1c1d150ec9c449818319537c412ed35c 2023-11-22 10:54:35,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:35,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:35,721 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c9b1865dc1f94231a698fa3719dd1c1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c9b1865dc1f94231a698fa3719dd1c1a 2023-11-22 10:54:35,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ac4af6f10c2d44789ad82f842eb2ed5e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ac4af6f10c2d44789ad82f842eb2ed5e 2023-11-22 10:54:35,722 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-22 10:54:35,722 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-22 10:54:35,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:35,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:35,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:35,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:35,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:35,724 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:35,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 893 msec 2023-11-22 10:54:35,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:54:35,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:36,187 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-22 10:54:36,188 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:36,188 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-22 10:54:36,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-22 10:54:36,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE}] 2023-11-22 10:54:36,193 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE 2023-11-22 10:54:36,194 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:36,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650476194"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650476194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650476194"}]},"ts":"1700650476194"} 2023-11-22 10:54:36,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:36,346 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:36,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c07847601fb4586ffd51842a7561949, disabling compactions & flushes 2023-11-22 10:54:36,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. after waiting 0 ms 2023-11-22 10:54:36,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-22 10:54:36,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:36,353 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 3c07847601fb4586ffd51842a7561949 to self. 2023-11-22 10:54:36,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,355 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=CLOSED 2023-11-22 10:54:36,355 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650476355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650476355"}]},"ts":"1700650476355"} 2023-11-22 10:54:36,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=52, resume processing ppid=51 2023-11-22 10:54:36,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831 in 161 msec 2023-11-22 10:54:36,357 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=true 2023-11-22 10:54:36,508 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:36,508 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650476508"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650476508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650476508"}]},"ts":"1700650476508"} 2023-11-22 10:54:36,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:36,661 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:36,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c07847601fb4586ffd51842a7561949, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,665 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,666 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:36,666 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1 2023-11-22 10:54:36,666 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c07847601fb4586ffd51842a7561949 columnFamilyName family1 2023-11-22 10:54:36,671 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/2cce9f0be4414c89be78ed051a00d7c5_SeqId_53_ 2023-11-22 10:54:36,674 DEBUG [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/family1/beeb69aa0a764d3fb933b24e4f081bfc 2023-11-22 10:54:36,675 INFO [StoreOpener-3c07847601fb4586ffd51842a7561949-1] regionserver.HStore(310): Store=3c07847601fb4586ffd51842a7561949/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:36,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:54:36,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c07847601fb4586ffd51842a7561949; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64290210, jitterRate=-0.04200121760368347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:36,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:54:36,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949., pid=53, masterSystemTime=1700650476661 2023-11-22 10:54:36,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:54:36,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=3c07847601fb4586ffd51842a7561949, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:36,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700650476681"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650476681"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650476681"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650476681"}]},"ts":"1700650476681"} 2023-11-22 10:54:36,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=53, resume processing ppid=51 2023-11-22 10:54:36,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 3c07847601fb4586ffd51842a7561949, server=jenkins-hbase4.apache.org,46051,1700650400831 in 174 msec 2023-11-22 10:54:36,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=51, resume processing ppid=50 2023-11-22 10:54:36,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=3c07847601fb4586ffd51842a7561949, REOPEN/MOVE in 492 msec 2023-11-22 10:54:36,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=50, resume processing ppid=49 2023-11-22 10:54:36,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-22 10:54:36,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 910 msec 2023-11-22 10:54:36,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-22 10:54:36,691 INFO [Listener at localhost/45227] compactions.TestMobCompactor(278): alter status finished 2023-11-22 10:54:36,692 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-22 10:54:36,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:36,693 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:36,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:36,694 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651076694 2023-11-22 10:54:36,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:36,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-22 10:54:36,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:36,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x41594894 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:36,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14aca865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-22 10:54:36,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-22 10:54:36,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:36,702 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-22 10:54:36,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-22 10:54:36,748 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 256), OpenFileDescriptor=647 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 202), ProcessCount=171 (was 171), AvailableMemoryMB=9584 (was 9591) 2023-11-22 10:54:36,759 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=158, ProcessCount=171, AvailableMemoryMB=9584 2023-11-22 10:54:36,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-22 10:54:36,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:36,762 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:36,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-22 10:54:36,763 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:36,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:36,764 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:36,765 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a empty. 2023-11-22 10:54:36,765 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:36,765 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-22 10:54:36,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:37,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:37,173 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:37,174 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => b15404ab0182f44b41d34545f368210a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:37,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing b15404ab0182f44b41d34545f368210a, disabling compactions & flushes 2023-11-22 10:54:37,580 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. after waiting 0 ms 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,580 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,580 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:37,582 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:37,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650477583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650477583"}]},"ts":"1700650477583"} 2023-11-22 10:54:37,585 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:54:37,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:37,585 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650477585"}]},"ts":"1700650477585"} 2023-11-22 10:54:37,586 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-22 10:54:37,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, ASSIGN}] 2023-11-22 10:54:37,591 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, ASSIGN 2023-11-22 10:54:37,591 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:37,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:37,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650477742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650477742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650477742"}]},"ts":"1700650477742"} 2023-11-22 10:54:37,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:37,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:37,895 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:37,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b15404ab0182f44b41d34545f368210a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:37,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:37,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,900 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,901 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:37,901 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:37,901 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b15404ab0182f44b41d34545f368210a columnFamilyName family1 2023-11-22 10:54:37,903 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(310): Store=b15404ab0182f44b41d34545f368210a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:37,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:37,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:37,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b15404ab0182f44b41d34545f368210a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72888847, jitterRate=0.08612845838069916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:37,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:37,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., pid=57, masterSystemTime=1700650477895 2023-11-22 10:54:37,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:37,911 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:37,911 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650477911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650477911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650477911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650477911"}]},"ts":"1700650477911"} 2023-11-22 10:54:37,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=57, resume processing ppid=56 2023-11-22 10:54:37,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 168 msec 2023-11-22 10:54:37,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=56, resume processing ppid=55 2023-11-22 10:54:37,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, ASSIGN in 324 msec 2023-11-22 10:54:37,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:54:37,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650477915"}]},"ts":"1700650477915"} 2023-11-22 10:54:37,916 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-22 10:54:37,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:54:37,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-11-22 10:54:38,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-22 10:54:38,868 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-22 10:54:38,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:38,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,891 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:38,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:38,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:38,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:38,892 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,892 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:38,894 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:38,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:38,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:38,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:38,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:38,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:38,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:38,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:38,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:38,896 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:38,896 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:38,896 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:38,896 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:38,897 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:54:39,319 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a48a818789e342ba8c05aa367b9bffde to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a48a818789e342ba8c05aa367b9bffde 2023-11-22 10:54:39,723 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/7388d2645c27455bb28219186799659f 2023-11-22 10:54:39,729 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/7388d2645c27455bb28219186799659f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f 2023-11-22 10:54:39,733 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-22 10:54:39,734 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 837ms, sequenceid=5, compaction requested=false 2023-11-22 10:54:39,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:39,735 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:39,735 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,737 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:39,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:39,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10845f9[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:39,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:39,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,740 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:39,740 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,741 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:39,742 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:39,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:39,745 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:39,745 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:39,745 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:39,745 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,745 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:39,751 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,751 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:39,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,751 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:39,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:39,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,753 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:39,756 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:39,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:39,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:39,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,756 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:39,757 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:39,757 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:39,857 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:39,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:39,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:39,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:39,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,863 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:39,863 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:39,863 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:39,863 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:39,863 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,864 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,865 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:39,865 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:39,865 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:39,865 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,866 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:39,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:39,866 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:39,866 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:39,866 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:39,867 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:39,867 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:39,867 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:54:40,021 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:54:40,279 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112857d499fd18c54f4b8f9d815b290fb59c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112857d499fd18c54f4b8f9d815b290fb59c 2023-11-22 10:54:40,583 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-22 10:54:40,684 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/5a6f7b749b95420a8218e3321ba39400 2023-11-22 10:54:40,689 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/5a6f7b749b95420a8218e3321ba39400 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400 2023-11-22 10:54:40,693 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:54:40,694 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 827ms, sequenceid=9, compaction requested=false 2023-11-22 10:54:40,694 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:40,694 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:40,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:40,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:40,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:40,694 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:40,696 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,696 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:40,697 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,697 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14143bd3[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:40,698 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:40,698 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,700 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,700 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:40,701 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,701 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:40,702 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:40,702 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:40,702 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,702 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:40,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:40,705 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:40,705 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:40,705 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:40,705 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,705 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:40,706 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,706 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:40,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,707 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:40,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:40,707 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,708 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,711 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:40,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:40,711 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:40,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:40,811 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:40,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:40,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,818 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:40,818 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:40,818 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:40,818 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:40,818 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,818 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,821 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:40,821 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:40,821 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:40,821 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:40,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:40,822 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:40,822 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:40,822 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:41,235 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b20e1243fb4445e8b54263d1639a281b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b20e1243fb4445e8b54263d1639a281b 2023-11-22 10:54:41,640 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/94778bed2a1240b087340a1b6da26f95 2023-11-22 10:54:41,644 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/94778bed2a1240b087340a1b6da26f95 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95 2023-11-22 10:54:41,648 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95, entries=1, sequenceid=13, filesize=5.0 K 2023-11-22 10:54:41,649 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 827ms, sequenceid=13, compaction requested=true 2023-11-22 10:54:41,649 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:41,649 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:41,651 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:41,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d47e5aa[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:41,652 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:41,652 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,653 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:41,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:41,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:41,654 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,654 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:41,655 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:41,655 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:41,655 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,655 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:41,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:41,658 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:41,658 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:41,658 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:41,658 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,658 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:41,661 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,661 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,661 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:41,662 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,663 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:41,672 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:41,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:41,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:41,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,672 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:41,673 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:41,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:41,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:41,773 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:41,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:41,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,779 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:41,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:41,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:41,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:41,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,784 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,784 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:41,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:41,784 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:41,784 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,785 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,785 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:41,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:41,786 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:41,786 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:41,786 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:42,198 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f463cc4c066b437b8a3e58f254ddfa12 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f463cc4c066b437b8a3e58f254ddfa12 2023-11-22 10:54:42,603 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/63b8845cef3043e2b3ad23b9513a6f19 2023-11-22 10:54:42,608 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/63b8845cef3043e2b3ad23b9513a6f19 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19 2023-11-22 10:54:42,612 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19, entries=1, sequenceid=17, filesize=5.0 K 2023-11-22 10:54:42,613 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 827ms, sequenceid=17, compaction requested=true 2023-11-22 10:54:42,613 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:42,613 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:42,615 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:42,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:42,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@478a8e84[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:42,617 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:42,617 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,618 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:42,618 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,618 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:42,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:42,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:42,620 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:42,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:42,622 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:42,622 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:42,622 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:42,622 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,622 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:42,626 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,626 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:42,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,627 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:42,627 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,628 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:42,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:42,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:42,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-22 10:54:42,631 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:42,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:42,731 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:42,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:42,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:42,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,737 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:42,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:42,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:42,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:42,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:42,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:42,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:42,740 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:42,740 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:42,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:42,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,741 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:42,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:42,741 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:42,742 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:42,742 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:43,155 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122877a57148ab284aa6a99ff6ba1a3da667 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a57148ab284aa6a99ff6ba1a3da667 2023-11-22 10:54:43,561 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/1de06957aa834f5492bfb3283438c4d2 2023-11-22 10:54:43,565 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/1de06957aa834f5492bfb3283438c4d2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2 2023-11-22 10:54:43,569 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2, entries=1, sequenceid=21, filesize=5.0 K 2023-11-22 10:54:43,570 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 828ms, sequenceid=21, compaction requested=true 2023-11-22 10:54:43,570 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:43,570 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:43,572 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,572 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:43,572 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,572 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46e2c01[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:43,574 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:43,574 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:43,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:43,576 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:43,577 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,577 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:43,578 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:43,578 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:43,578 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:43,578 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:43,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:43,580 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:43,580 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:43,581 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:43,581 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,581 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:43,582 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,582 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:43,582 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:43,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:43,583 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,584 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,587 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:43,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:43,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:43,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:43,587 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,588 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:43,588 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:43,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:43,688 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:43,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:43,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:43,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:43,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,694 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:43,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:43,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:43,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:43,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,694 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,697 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,697 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:43,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:43,697 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:43,697 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,698 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:43,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:43,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:43,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:43,698 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:43,699 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:43,699 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:43,699 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:43,699 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:43,699 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:44,114 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123137099c5b0efd4036b399598a5cfae540 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123137099c5b0efd4036b399598a5cfae540 2023-11-22 10:54:44,519 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/50a8e5b556814f928c9a52d03cff2c4c 2023-11-22 10:54:44,523 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/50a8e5b556814f928c9a52d03cff2c4c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c 2023-11-22 10:54:44,527 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c, entries=1, sequenceid=25, filesize=5.0 K 2023-11-22 10:54:44,528 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 829ms, sequenceid=25, compaction requested=true 2023-11-22 10:54:44,528 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:44,528 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:44,530 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,530 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:44,530 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:44,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:44,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@311155fc[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:44,532 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:44,532 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,533 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:44,534 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,534 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:44,535 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:44,535 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,535 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:44,535 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:44,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:44,538 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:44,538 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:44,538 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:44,538 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,538 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:44,539 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,539 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:44,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,540 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:44,540 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,541 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:44,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,544 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:44,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:44,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:44,544 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:44,644 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:44,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:44,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,650 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:44,650 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:44,650 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:44,650 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:44,651 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,651 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,652 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:44,652 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:44,652 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:44,652 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,653 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:44,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:44,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:44,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:44,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:44,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:44,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:44,654 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:44,654 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:44,654 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:45,066 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010161535c7abc1e430e932789665cae5371 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010161535c7abc1e430e932789665cae5371 2023-11-22 10:54:45,471 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/a94e4772539542b283d7386b91fa3983 2023-11-22 10:54:45,476 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/a94e4772539542b283d7386b91fa3983 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983 2023-11-22 10:54:45,479 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983, entries=1, sequenceid=29, filesize=5.0 K 2023-11-22 10:54:45,480 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 826ms, sequenceid=29, compaction requested=true 2023-11-22 10:54:45,480 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:45,480 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:45,483 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,483 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:45,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:45,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73b98cc1[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:45,485 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:45,485 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,486 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:45,486 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,486 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:45,487 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:45,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:45,490 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:45,490 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:45,490 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:45,490 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,490 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:45,491 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,491 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:45,491 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:45,492 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,493 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:45,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:45,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:45,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:45,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:45,496 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:45,496 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:45,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-22 10:54:45,497 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:45,597 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:45,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:45,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:45,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:45,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,603 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:45,603 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:45,603 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:45,603 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:45,604 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,604 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,605 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:45,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:45,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:45,605 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:45,608 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:45,608 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:45,608 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:46,022 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010387211eea7cc7454683498ed20483d96f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010387211eea7cc7454683498ed20483d96f 2023-11-22 10:54:46,427 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/82b5e32581f44e89bcb0cbaa67e7f908 2023-11-22 10:54:46,432 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/82b5e32581f44e89bcb0cbaa67e7f908 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908 2023-11-22 10:54:46,437 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908, entries=1, sequenceid=33, filesize=5.0 K 2023-11-22 10:54:46,438 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 830ms, sequenceid=33, compaction requested=true 2023-11-22 10:54:46,438 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:46,438 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:46,438 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:46,438 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:46,438 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,438 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:46,438 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:46,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,440 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,440 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6054c29c[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:46,442 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:46,442 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,443 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:46,444 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,444 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:46,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:46,448 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,448 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:46,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:46,450 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:46,450 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:46,450 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:46,451 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,451 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:46,452 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,452 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,452 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:46,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:46,453 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,454 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:46,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:46,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:46,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,457 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:46,457 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:46,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:46,557 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:46,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:46,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,563 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:46,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:46,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:46,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:46,564 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,564 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,565 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,565 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:46,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:46,565 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,565 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:46,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:46,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:46,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:46,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:46,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:46,567 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:46,567 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:46,567 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:46,585 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e8d172facc374d478c1fe25498bd5687 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907e8d172facc374d478c1fe25498bd5687 2023-11-22 10:54:46,591 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/9df109662d9b46dc90209279bb83dc2a 2023-11-22 10:54:46,596 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/9df109662d9b46dc90209279bb83dc2a as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a 2023-11-22 10:54:46,600 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a, entries=1, sequenceid=37, filesize=5.0 K 2023-11-22 10:54:46,601 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 34ms, sequenceid=37, compaction requested=true 2023-11-22 10:54:46,601 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:46,601 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:46,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:46,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:46,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:46,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:46,604 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:46,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15aff4b3[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:46,606 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:46,606 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,608 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:46,608 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,608 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:46,609 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,609 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,610 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:46,610 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:46,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:46,613 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:46,613 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:46,613 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:46,613 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,613 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:46,614 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,614 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,614 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:46,615 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,616 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,620 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:46,620 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-22 10:54:46,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:46,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:46,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:46,621 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:46,621 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:46,621 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:46,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:46,721 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:46,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:46,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:54:46,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-22 10:54:46,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,728 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:46,728 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:46,728 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-22 10:54:46,728 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-22 10:54:46,729 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,729 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,730 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:46,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:46,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:46,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:46,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:54:46,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:54:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,731 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,731 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-22 10:54:46,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:46,731 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-22 10:54:46,731 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:54:46,731 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-22 10:54:46,732 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:54:46,732 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:54:46,732 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:46,732 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. started... 2023-11-22 10:54:46,732 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b15404ab0182f44b41d34545f368210a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:54:47,144 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202029c940a07d4ba7b704917ebb19d2f7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202029c940a07d4ba7b704917ebb19d2f7 2023-11-22 10:54:47,549 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/cf05d3b4226443d9aa485370c1279519 2023-11-22 10:54:47,554 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/cf05d3b4226443d9aa485370c1279519 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519 2023-11-22 10:54:47,575 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:47,575 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bfd423b to 127.0.0.1:57046 2023-11-22 10:54:47,575 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:47,576 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41594894 to 127.0.0.1:57046 2023-11-22 10:54:47,576 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:47,577 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:47,577 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01fe8910 to 127.0.0.1:57046 2023-11-22 10:54:47,577 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:47,577 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:47,577 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73d3e8f3 to 127.0.0.1:57046 2023-11-22 10:54:47,577 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:47,578 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519, entries=1, sequenceid=41, filesize=5.0 K 2023-11-22 10:54:47,579 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b15404ab0182f44b41d34545f368210a in 847ms, sequenceid=41, compaction requested=true 2023-11-22 10:54:47,579 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:47,579 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-22 10:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-22 10:54:47,582 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,582 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:47,582 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,582 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:54:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-22 10:54:47,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2eaafd4f[Count = 0] remaining members to acquire global barrier 2023-11-22 10:54:47,583 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-22 10:54:47,584 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,584 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-22 10:54:47,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-22 10:54:47,585 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:54:47,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:54:47,586 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,586 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-22 10:54:47,586 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:47,586 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-22 10:54:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:47,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:47,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:54:47,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-22 10:54:47,588 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-22 10:54:47,588 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:54:47,588 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:54:47,588 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,588 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:54:47,593 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,593 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,593 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:54:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:54:47,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:47,594 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:54:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:54:47,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,595 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:54:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:47,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:54:47,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:54:47,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:54:47,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,597 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:54:47,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:54:47,598 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,597 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:54:47,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:54:47,698 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:54:47,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:54:47,700 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:47,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:47,702 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:47,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:47,702 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651087702 2023-11-22 10:54:47,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:47,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-22 10:54:47,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:47,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x6694cb40 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:47,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4799e070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:47,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,546 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010385cc25cadad346738fc94bc5df3fe27d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010385cc25cadad346738fc94bc5df3fe27d 2023-11-22 10:54:48,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:48,560 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:48,561 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:48,567 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:48,568 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:48,576 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2104588c9cf447fb9bb24b7d2897848e first=Optional[r3] last=Optional[r6] 2023-11-22 10:54:48,577 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2104588c9cf447fb9bb24b7d2897848e}] 2023-11-22 10:54:48,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2104588c9cf447fb9bb24b7d2897848e for inclusion in b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:48,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-22 10:54:48,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:48,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:48,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2104588c9cf447fb9bb24b7d2897848e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tq7qms0i8g6oaoq0pr7kchsp8hvf4se49s0k982fq873ek4ovfmp2hm0888sik3n/family1/2104588c9cf447fb9bb24b7d2897848e 2023-11-22 10:54:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tq7qms0i8g6oaoq0pr7kchsp8hvf4se49s0k982fq873ek4ovfmp2hm0888sik3n/family1/2104588c9cf447fb9bb24b7d2897848e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_ 2023-11-22 10:54:48,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tq7qms0i8g6oaoq0pr7kchsp8hvf4se49s0k982fq873ek4ovfmp2hm0888sik3n/family1/2104588c9cf447fb9bb24b7d2897848e into b15404ab0182f44b41d34545f368210a/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_ - updating store file list. 2023-11-22 10:54:48,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_ into b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:48,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tq7qms0i8g6oaoq0pr7kchsp8hvf4se49s0k982fq873ek4ovfmp2hm0888sik3n/family1/2104588c9cf447fb9bb24b7d2897848e into b15404ab0182f44b41d34545f368210a/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_) 2023-11-22 10:54:48,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tq7qms0i8g6oaoq0pr7kchsp8hvf4se49s0k982fq873ek4ovfmp2hm0888sik3n/family1/2104588c9cf447fb9bb24b7d2897848e 2023-11-22 10:54:48,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:54:48,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:54:48,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): b15404ab0182f44b41d34545f368210a/family1 is initiating minor compaction 2023-11-22 10:54:48,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7729ec1d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:48,596 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b15404ab0182f44b41d34545f368210a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:48,596 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp, totalSize=50.3 K 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 5a6f7b749b95420a8218e3321ba39400, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 94778bed2a1240b087340a1b6da26f95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 63b8845cef3043e2b3ad23b9513a6f19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 1de06957aa834f5492bfb3283438c4d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 50a8e5b556814f928c9a52d03cff2c4c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting a94e4772539542b283d7386b91fa3983, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 82b5e32581f44e89bcb0cbaa67e7f908, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:54:48,596 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 9df109662d9b46dc90209279bb83dc2a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:54:48,597 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting cf05d3b4226443d9aa485370c1279519, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:54:48,597 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:54:48,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:48,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:48,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a57148ab284aa6a99ff6ba1a3da667 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a57148ab284aa6a99ff6ba1a3da667 2023-11-22 10:54:48,601 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123137099c5b0efd4036b399598a5cfae540 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123137099c5b0efd4036b399598a5cfae540 2023-11-22 10:54:48,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010161535c7abc1e430e932789665cae5371 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010161535c7abc1e430e932789665cae5371 2023-11-22 10:54:48,604 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010387211eea7cc7454683498ed20483d96f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010387211eea7cc7454683498ed20483d96f 2023-11-22 10:54:48,604 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-22 10:54:48,604 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-22 10:54:48,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:48,620 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b15404ab0182f44b41d34545f368210a#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:49,434 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/b23889a9c6e24113818ffdc10ae3f713 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/b23889a9c6e24113818ffdc10ae3f713 2023-11-22 10:54:49,436 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205610c99ea31554860b3926e35b57b95ef to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205610c99ea31554860b3926e35b57b95ef 2023-11-22 10:54:49,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:49,439 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b15404ab0182f44b41d34545f368210a/family1 of b15404ab0182f44b41d34545f368210a into b23889a9c6e24113818ffdc10ae3f713(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:49,439 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:49,439 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700650488595; duration=0sec 2023-11-22 10:54:49,439 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:49,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_] to archive 2023-11-22 10:54:49,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:49,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/5a6f7b749b95420a8218e3321ba39400 2023-11-22 10:54:49,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/94778bed2a1240b087340a1b6da26f95 2023-11-22 10:54:49,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/63b8845cef3043e2b3ad23b9513a6f19 2023-11-22 10:54:49,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/1de06957aa834f5492bfb3283438c4d2 2023-11-22 10:54:49,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/50a8e5b556814f928c9a52d03cff2c4c 2023-11-22 10:54:49,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/a94e4772539542b283d7386b91fa3983 2023-11-22 10:54:49,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/82b5e32581f44e89bcb0cbaa67e7f908 2023-11-22 10:54:49,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/9df109662d9b46dc90209279bb83dc2a 2023-11-22 10:54:49,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/cf05d3b4226443d9aa485370c1279519 2023-11-22 10:54:49,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/74414e4e4b40428d9a06c4e99a0ceeda_SeqId_44_ 2023-11-22 10:54:49,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/411e6167a9f84f66b08ee34522a0bbe1 first=Optional[r00] last=Optional[r2] 2023-11-22 10:54:49,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/411e6167a9f84f66b08ee34522a0bbe1}] 2023-11-22 10:54:49,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/411e6167a9f84f66b08ee34522a0bbe1 for inclusion in b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:49,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-22 10:54:49,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:49,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:49,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/411e6167a9f84f66b08ee34522a0bbe1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o7ju2jhstkh0djaej79tjfh6ob0aqf5h63tqg42rij3tfevrbg3ictscdgikf586/family1/411e6167a9f84f66b08ee34522a0bbe1 2023-11-22 10:54:49,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o7ju2jhstkh0djaej79tjfh6ob0aqf5h63tqg42rij3tfevrbg3ictscdgikf586/family1/411e6167a9f84f66b08ee34522a0bbe1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_ 2023-11-22 10:54:49,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o7ju2jhstkh0djaej79tjfh6ob0aqf5h63tqg42rij3tfevrbg3ictscdgikf586/family1/411e6167a9f84f66b08ee34522a0bbe1 into b15404ab0182f44b41d34545f368210a/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_ - updating store file list. 2023-11-22 10:54:49,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_ into b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:49,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o7ju2jhstkh0djaej79tjfh6ob0aqf5h63tqg42rij3tfevrbg3ictscdgikf586/family1/411e6167a9f84f66b08ee34522a0bbe1 into b15404ab0182f44b41d34545f368210a/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_) 2023-11-22 10:54:49,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o7ju2jhstkh0djaej79tjfh6ob0aqf5h63tqg42rij3tfevrbg3ictscdgikf586/family1/411e6167a9f84f66b08ee34522a0bbe1 2023-11-22 10:54:49,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:54:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:54:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): b15404ab0182f44b41d34545f368210a/family1 is initiating minor compaction (all files) 2023-11-22 10:54:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@435d187c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:49,487 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b15404ab0182f44b41d34545f368210a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:49,487 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/b23889a9c6e24113818ffdc10ae3f713, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp, totalSize=388.1 K 2023-11-22 10:54:49,488 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 7388d2645c27455bb28219186799659f, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:54:49,488 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting b23889a9c6e24113818ffdc10ae3f713, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:54:49,489 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 26a6928d18064228be1ca4d6b64b7216_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824734 2023-11-22 10:54:49,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:49,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:49,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a48a818789e342ba8c05aa367b9bffde to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a48a818789e342ba8c05aa367b9bffde 2023-11-22 10:54:49,492 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b20e1243fb4445e8b54263d1639a281b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b20e1243fb4445e8b54263d1639a281b 2023-11-22 10:54:49,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f463cc4c066b437b8a3e58f254ddfa12 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f463cc4c066b437b8a3e58f254ddfa12 2023-11-22 10:54:49,493 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-22 10:54:49,493 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-22 10:54:49,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:49,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:49,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:49,494 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:49,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7950 sec 2023-11-22 10:54:49,503 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b15404ab0182f44b41d34545f368210a#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:49,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-22 10:54:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:49,971 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:49,972 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:49,972 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:49,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-22 10:54:49,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE}] 2023-11-22 10:54:49,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE 2023-11-22 10:54:49,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:49,977 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650489977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650489977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650489977"}]},"ts":"1700650489977"} 2023-11-22 10:54:49,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:50,130 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:50,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:50,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b15404ab0182f44b41d34545f368210a, disabling compactions & flushes 2023-11-22 10:54:50,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:50,721 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/.tmp/family1/4c159f412fb04b8397754703a9e256ad as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/4c159f412fb04b8397754703a9e256ad 2023-11-22 10:54:50,726 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b15404ab0182f44b41d34545f368210a/family1 of b15404ab0182f44b41d34545f368210a into 4c159f412fb04b8397754703a9e256ad(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:54:50,726 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:50,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:50,726 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1700650489487; duration=1sec 2023-11-22 10:54:50,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:50,726 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:50,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. after waiting 0 ms 2023-11-22 10:54:50,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:50,729 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/b23889a9c6e24113818ffdc10ae3f713, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_] to archive 2023-11-22 10:54:50,729 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:50,731 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/7388d2645c27455bb28219186799659f 2023-11-22 10:54:50,732 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/b23889a9c6e24113818ffdc10ae3f713 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/b23889a9c6e24113818ffdc10ae3f713 2023-11-22 10:54:50,733 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/26a6928d18064228be1ca4d6b64b7216_SeqId_47_ 2023-11-22 10:54:50,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-22 10:54:50,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:50,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:50,738 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: b15404ab0182f44b41d34545f368210a to self. 2023-11-22 10:54:50,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:50,739 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=CLOSED 2023-11-22 10:54:50,739 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650490739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650490739"}]},"ts":"1700650490739"} 2023-11-22 10:54:50,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=62, resume processing ppid=61 2023-11-22 10:54:50,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 762 msec 2023-11-22 10:54:50,742 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=true 2023-11-22 10:54:50,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:50,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650490892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650490892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650490892"}]},"ts":"1700650490892"} 2023-11-22 10:54:50,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:51,046 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:51,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b15404ab0182f44b41d34545f368210a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,050 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,051 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:51,051 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:51,051 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b15404ab0182f44b41d34545f368210a columnFamilyName family1 2023-11-22 10:54:51,056 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/4c159f412fb04b8397754703a9e256ad 2023-11-22 10:54:51,056 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(310): Store=b15404ab0182f44b41d34545f368210a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:51,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:51,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b15404ab0182f44b41d34545f368210a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68089757, jitterRate=0.014616444706916809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:51,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:51,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., pid=63, masterSystemTime=1700650491045 2023-11-22 10:54:51,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:51,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:51,063 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:51,063 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650491063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650491063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650491063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650491063"}]},"ts":"1700650491063"} 2023-11-22 10:54:51,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=63, resume processing ppid=61 2023-11-22 10:54:51,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 170 msec 2023-11-22 10:54:51,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=61, resume processing ppid=60 2023-11-22 10:54:51,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE in 1.0900 sec 2023-11-22 10:54:51,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=60, resume processing ppid=59 2023-11-22 10:54:51,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0930 sec 2023-11-22 10:54:51,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5070 sec 2023-11-22 10:54:51,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-22 10:54:51,071 INFO [Listener at localhost/45227] compactions.TestMobCompactor(278): alter status finished 2023-11-22 10:54:51,072 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:51,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:51,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:51,074 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651091074 2023-11-22 10:54:51,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:51,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:51,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-22 10:54:51,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:51,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x05445e74 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:51,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@200ff29c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:51,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,906 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f33ffa9ee6ec4819ac8f3bd89453ce4a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f33ffa9ee6ec4819ac8f3bd89453ce4a 2023-11-22 10:54:51,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:51,919 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:51,920 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:51,925 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:51,927 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:51,934 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a36cf3c1cad24b5183af780b090638aa first=Optional[r05] last=Optional[r8] 2023-11-22 10:54:51,935 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a36cf3c1cad24b5183af780b090638aa}] 2023-11-22 10:54:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a36cf3c1cad24b5183af780b090638aa for inclusion in b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:51,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-22 10:54:51,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:51,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a36cf3c1cad24b5183af780b090638aa to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u1e9t7iddvcaaq0ea2sv7s0lsrpnn3s4ead4qctvlkb7avpokbr2l8klhg32ds9g/family1/a36cf3c1cad24b5183af780b090638aa 2023-11-22 10:54:51,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u1e9t7iddvcaaq0ea2sv7s0lsrpnn3s4ead4qctvlkb7avpokbr2l8klhg32ds9g/family1/a36cf3c1cad24b5183af780b090638aa as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/86e01ec39adf40b3b417b2db5a2e3c2e_SeqId_53_ 2023-11-22 10:54:51,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u1e9t7iddvcaaq0ea2sv7s0lsrpnn3s4ead4qctvlkb7avpokbr2l8klhg32ds9g/family1/a36cf3c1cad24b5183af780b090638aa into b15404ab0182f44b41d34545f368210a/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/86e01ec39adf40b3b417b2db5a2e3c2e_SeqId_53_ - updating store file list. 2023-11-22 10:54:51,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/86e01ec39adf40b3b417b2db5a2e3c2e_SeqId_53_ into b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:51,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u1e9t7iddvcaaq0ea2sv7s0lsrpnn3s4ead4qctvlkb7avpokbr2l8klhg32ds9g/family1/a36cf3c1cad24b5183af780b090638aa into b15404ab0182f44b41d34545f368210a/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/86e01ec39adf40b3b417b2db5a2e3c2e_SeqId_53_) 2023-11-22 10:54:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u1e9t7iddvcaaq0ea2sv7s0lsrpnn3s4ead4qctvlkb7avpokbr2l8klhg32ds9g/family1/a36cf3c1cad24b5183af780b090638aa 2023-11-22 10:54:51,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:51,950 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:51,952 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202029c940a07d4ba7b704917ebb19d2f7 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202029c940a07d4ba7b704917ebb19d2f7 2023-11-22 10:54:51,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112857d499fd18c54f4b8f9d815b290fb59c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112857d499fd18c54f4b8f9d815b290fb59c 2023-11-22 10:54:51,953 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-22 10:54:51,953 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-22 10:54:51,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:51,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:51,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:51,954 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:51,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 881 msec 2023-11-22 10:54:52,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-22 10:54:52,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:52,411 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-22 10:54:52,412 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-22 10:54:52,412 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-22 10:54:52,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-22 10:54:52,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE}] 2023-11-22 10:54:52,420 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE 2023-11-22 10:54:52,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:52,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650492421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650492421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650492421"}]},"ts":"1700650492421"} 2023-11-22 10:54:52,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:52,573 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:52,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b15404ab0182f44b41d34545f368210a, disabling compactions & flushes 2023-11-22 10:54:52,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. after waiting 0 ms 2023-11-22 10:54:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-22 10:54:52,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:52,581 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: b15404ab0182f44b41d34545f368210a to self. 2023-11-22 10:54:52,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=CLOSED 2023-11-22 10:54:52,583 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650492583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650492583"}]},"ts":"1700650492583"} 2023-11-22 10:54:52,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=68, resume processing ppid=67 2023-11-22 10:54:52,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 162 msec 2023-11-22 10:54:52,585 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=true 2023-11-22 10:54:52,736 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:52,736 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650492736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650492736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650492736"}]},"ts":"1700650492736"} 2023-11-22 10:54:52,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:52,889 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:52,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b15404ab0182f44b41d34545f368210a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:52,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:52,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,893 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,893 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:52,893 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1 2023-11-22 10:54:52,894 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b15404ab0182f44b41d34545f368210a columnFamilyName family1 2023-11-22 10:54:52,898 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/4c159f412fb04b8397754703a9e256ad 2023-11-22 10:54:52,901 DEBUG [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/family1/86e01ec39adf40b3b417b2db5a2e3c2e_SeqId_53_ 2023-11-22 10:54:52,902 INFO [StoreOpener-b15404ab0182f44b41d34545f368210a-1] regionserver.HStore(310): Store=b15404ab0182f44b41d34545f368210a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:52,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b15404ab0182f44b41d34545f368210a 2023-11-22 10:54:52,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b15404ab0182f44b41d34545f368210a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69552725, jitterRate=0.03641636669635773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:54:52,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a., pid=69, masterSystemTime=1700650492889 2023-11-22 10:54:52,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:54:52,909 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b15404ab0182f44b41d34545f368210a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:52,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700650492909"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650492909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650492909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650492909"}]},"ts":"1700650492909"} 2023-11-22 10:54:52,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=69, resume processing ppid=67 2023-11-22 10:54:52,912 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure b15404ab0182f44b41d34545f368210a, server=jenkins-hbase4.apache.org,46051,1700650400831 in 173 msec 2023-11-22 10:54:52,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=67, resume processing ppid=66 2023-11-22 10:54:52,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b15404ab0182f44b41d34545f368210a, REOPEN/MOVE in 493 msec 2023-11-22 10:54:52,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=66, resume processing ppid=65 2023-11-22 10:54:52,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 496 msec 2023-11-22 10:54:52,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-11-22 10:54:52,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-22 10:54:52,918 INFO [Listener at localhost/45227] compactions.TestMobCompactor(278): alter status finished 2023-11-22 10:54:52,919 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-22 10:54:52,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:52,921 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:52,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:52,922 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651092922 2023-11-22 10:54:52,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:54:52,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-22 10:54:52,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:52,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x0644ca83 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:52,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521a0242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-22 10:54:52,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-22 10:54:52,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:52,930 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-22 10:54:52,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-22 10:54:52,978 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244 (was 248), OpenFileDescriptor=645 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 158), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=9536 (was 9584) 2023-11-22 10:54:52,989 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=173, AvailableMemoryMB=9535 2023-11-22 10:54:52,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-22 10:54:52,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:52,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:52,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-22 10:54:52,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:52,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:52,996 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:52,997 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 empty. 2023-11-22 10:54:52,997 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:52,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-22 10:54:53,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:53,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:53,405 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:53,406 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1114ad4610722030e07a220babaa77d5, NAME => 'testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:53,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:53,811 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:53,811 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 1114ad4610722030e07a220babaa77d5, disabling compactions & flushes 2023-11-22 10:54:53,811 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:53,811 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:53,812 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. after waiting 0 ms 2023-11-22 10:54:53,812 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:53,812 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:53,812 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:53,814 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:53,815 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700650493814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650493814"}]},"ts":"1700650493814"} 2023-11-22 10:54:53,816 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:54:53,816 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:53,816 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650493816"}]},"ts":"1700650493816"} 2023-11-22 10:54:53,817 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-22 10:54:53,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, ASSIGN}] 2023-11-22 10:54:53,822 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, ASSIGN 2023-11-22 10:54:53,822 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:53,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1114ad4610722030e07a220babaa77d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:53,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700650493973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650493973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650493973"}]},"ts":"1700650493973"} 2023-11-22 10:54:53,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 1114ad4610722030e07a220babaa77d5, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:54,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:54,126 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:54,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:54,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1114ad4610722030e07a220babaa77d5, NAME => 'testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:54:54,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-22 10:54:54,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-22 10:54:54,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,132 INFO [StoreOpener-1114ad4610722030e07a220babaa77d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,133 DEBUG [StoreOpener-1114ad4610722030e07a220babaa77d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1 2023-11-22 10:54:54,133 DEBUG [StoreOpener-1114ad4610722030e07a220babaa77d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1 2023-11-22 10:54:54,133 INFO [StoreOpener-1114ad4610722030e07a220babaa77d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1114ad4610722030e07a220babaa77d5 columnFamilyName f1 2023-11-22 10:54:54,135 INFO [StoreOpener-1114ad4610722030e07a220babaa77d5-1] regionserver.HStore(310): Store=1114ad4610722030e07a220babaa77d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:54:54,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:54,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:54:54,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1114ad4610722030e07a220babaa77d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71045509, jitterRate=0.05866058170795441}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:54,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5., pid=73, masterSystemTime=1700650494126 2023-11-22 10:54:54,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:54,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:54,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1114ad4610722030e07a220babaa77d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:54,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700650494142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650494142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650494142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650494142"}]},"ts":"1700650494142"} 2023-11-22 10:54:54,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=73, resume processing ppid=72 2023-11-22 10:54:54,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 1114ad4610722030e07a220babaa77d5, server=jenkins-hbase4.apache.org,46051,1700650400831 in 168 msec 2023-11-22 10:54:54,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=72, resume processing ppid=71 2023-11-22 10:54:54,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, ASSIGN in 324 msec 2023-11-22 10:54:54,146 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:54:54,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650494146"}]},"ts":"1700650494146"} 2023-11-22 10:54:54,147 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-22 10:54:54,149 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:54:54,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-11-22 10:54:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-22 10:54:55,100 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-22 10:54:55,100 DEBUG [Listener at localhost/45227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-22 10:54:55,102 INFO [Listener at localhost/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-22 10:54:55,105 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-22 10:54:55,105 INFO [Listener at localhost/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-22 10:54:55,105 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-22 10:54:55,110 INFO [Listener at localhost/45227] regionserver.HRegion(2745): Flushing 1114ad4610722030e07a220babaa77d5 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-22 10:54:55,526 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122af7337eedbda4aec98242442e04a0eeb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231122af7337eedbda4aec98242442e04a0eeb 2023-11-22 10:54:55,917 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:55,918 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05445e74 to 127.0.0.1:57046 2023-11-22 10:54:55,918 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:55,918 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0644ca83 to 127.0.0.1:57046 2023-11-22 10:54:55,918 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:55,919 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-22 10:54:55,922 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:54:55,922 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6694cb40 to 127.0.0.1:57046 2023-11-22 10:54:55,922 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:54:55,932 INFO [Listener at localhost/45227] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp/f1/6076c48723de470fba85363be90690ca 2023-11-22 10:54:55,937 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp/f1/6076c48723de470fba85363be90690ca as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca 2023-11-22 10:54:55,941 INFO [Listener at localhost/45227] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca, entries=1, sequenceid=5, filesize=4.9 K 2023-11-22 10:54:55,943 INFO [Listener at localhost/45227] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1114ad4610722030e07a220babaa77d5 in 833ms, sequenceid=5, compaction requested=false 2023-11-22 10:54:55,943 DEBUG [Listener at localhost/45227] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-22 10:54:55,944 DEBUG [Listener at localhost/45227] regionserver.HRegion(2446): Flush status journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:55,946 INFO [Listener at localhost/45227] regionserver.HRegion(2745): Flushing 1114ad4610722030e07a220babaa77d5 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-22 10:54:56,362 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112272f846bcb98c4d7ab12f70a758bd8d30 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112272f846bcb98c4d7ab12f70a758bd8d30 2023-11-22 10:54:56,439 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:54:56,768 INFO [Listener at localhost/45227] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp/f1/559977791ae14826bd8324cef78e85fd 2023-11-22 10:54:56,773 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp/f1/559977791ae14826bd8324cef78e85fd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd 2023-11-22 10:54:56,776 INFO [Listener at localhost/45227] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd, entries=1, sequenceid=9, filesize=4.9 K 2023-11-22 10:54:56,777 INFO [Listener at localhost/45227] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1114ad4610722030e07a220babaa77d5 in 831ms, sequenceid=9, compaction requested=false 2023-11-22 10:54:56,777 DEBUG [Listener at localhost/45227] regionserver.HRegion(2446): Flush status journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:56,779 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-22 10:54:56,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-22 10:54:56,780 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-22 10:54:56,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:56,781 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651096781 2023-11-22 10:54:56,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:54:56,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-22 10:54:56,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-22 10:54:56,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x09f10c60 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:54:56,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7b170e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:54:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231122 for table='testGetAfterCompaction' and column='f1' 2023-11-22 10:54:56,830 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,830 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,881 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,881 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,932 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,932 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,982 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:56,983 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,033 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,033 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,084 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,084 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,135 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,135 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,186 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,186 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,237 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,237 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,288 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,288 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,339 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,339 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,390 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,390 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,440 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,441 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,491 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,491 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,542 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,542 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,593 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,593 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,610 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311221985dc9b102b416db3d9820fc3970484 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311221985dc9b102b416db3d9820fc3970484 2023-11-22 10:54:57,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testGetAfterCompaction' column='f1' 2023-11-22 10:54:57,623 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:54:57,624 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:54:57,630 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:54:57,632 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:54:57,640 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/f1/0b312459a86f4c6fa6f4bb0c84a3a020 first=Optional[r1] last=Optional[r2] 2023-11-22 10:54:57,640 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/f1/0b312459a86f4c6fa6f4bb0c84a3a020}] 2023-11-22 10:54:57,644 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/f1/0b312459a86f4c6fa6f4bb0c84a3a020 for inclusion in 1114ad4610722030e07a220babaa77d5/f1 2023-11-22 10:54:57,644 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-22 10:54:57,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:54:57,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:57,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/f1/0b312459a86f4c6fa6f4bb0c84a3a020 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testGetAfterCompaction__t64m6s0g7i2ueat3908n30dnfele4livs9gd2m40rh02qe73q09pkruoep0memse/f1/0b312459a86f4c6fa6f4bb0c84a3a020 2023-11-22 10:54:57,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testGetAfterCompaction__t64m6s0g7i2ueat3908n30dnfele4livs9gd2m40rh02qe73q09pkruoep0memse/f1/0b312459a86f4c6fa6f4bb0c84a3a020 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_ 2023-11-22 10:54:57,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testGetAfterCompaction__t64m6s0g7i2ueat3908n30dnfele4livs9gd2m40rh02qe73q09pkruoep0memse/f1/0b312459a86f4c6fa6f4bb0c84a3a020 into 1114ad4610722030e07a220babaa77d5/f1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_ - updating store file list. 2023-11-22 10:54:57,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_ into 1114ad4610722030e07a220babaa77d5/f1 2023-11-22 10:54:57,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testGetAfterCompaction__t64m6s0g7i2ueat3908n30dnfele4livs9gd2m40rh02qe73q09pkruoep0memse/f1/0b312459a86f4c6fa6f4bb0c84a3a020 into 1114ad4610722030e07a220babaa77d5/f1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_) 2023-11-22 10:54:57,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testGetAfterCompaction__t64m6s0g7i2ueat3908n30dnfele4livs9gd2m40rh02qe73q09pkruoep0memse/f1/0b312459a86f4c6fa6f4bb0c84a3a020 2023-11-22 10:54:57,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): 1114ad4610722030e07a220babaa77d5/f1 is initiating minor compaction 2023-11-22 10:54:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a100f53; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:57,654 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1114ad4610722030e07a220babaa77d5/f1 in testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:57,654 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp, totalSize=10.0 K 2023-11-22 10:54:57,654 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 559977791ae14826bd8324cef78e85fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:54:57,654 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting bc8b2432072e4e339f1a343538b439c7_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:54:57,655 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testGetAfterCompaction' column='f1' 2023-11-22 10:54:57,656 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:57,658 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112272f846bcb98c4d7ab12f70a758bd8d30 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112272f846bcb98c4d7ab12f70a758bd8d30 2023-11-22 10:54:57,659 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231122af7337eedbda4aec98242442e04a0eeb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231122af7337eedbda4aec98242442e04a0eeb 2023-11-22 10:54:57,659 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-22 10:54:57,659 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231122' 2023-11-22 10:54:57,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231122 for table='testGetAfterCompaction' and column='f1' 2023-11-22 10:54:57,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-22 10:54:57,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:54:57,660 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-22 10:54:57,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 882 msec 2023-11-22 10:54:57,662 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1114ad4610722030e07a220babaa77d5#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:54:57,695 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,695 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,695 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:57,699 DEBUG [Listener at localhost/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-22 10:54:57,703 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-22 10:54:57,703 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46051] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:57,704 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-22 10:54:57,704 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-22 10:54:57,704 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46051] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-22 10:54:57,704 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46051] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. because compaction request was cancelled 2023-11-22 10:54:57,756 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,756 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,756 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:57,807 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,807 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,807 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:57,858 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,858 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,858 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:57,909 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,909 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,909 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:57,959 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,960 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:57,960 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,010 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,010 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,010 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,061 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,061 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,062 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,112 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,112 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,112 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,163 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,163 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,163 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,214 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,214 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,214 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,265 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,265 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,265 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,316 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,316 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,316 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,367 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,367 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,367 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,417 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,418 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,418 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,468 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,468 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,468 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,477 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/.tmp/f1/2694e6dd2cd645699262d0422a2bf1b4 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/2694e6dd2cd645699262d0422a2bf1b4 2023-11-22 10:54:58,481 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 1114ad4610722030e07a220babaa77d5/f1 of 1114ad4610722030e07a220babaa77d5 into 2694e6dd2cd645699262d0422a2bf1b4(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:54:58,481 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:58,481 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700650497653; duration=0sec 2023-11-22 10:54:58,481 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:54:58,519 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/2694e6dd2cd645699262d0422a2bf1b4; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700650498472; access_time=1700650497659; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,519 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650496768; access_time=1700650495947; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,519 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,519 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700650497606; access_time=1700650496798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-22 10:54:58,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_] to archive 2023-11-22 10:54:58,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:54:58,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/559977791ae14826bd8324cef78e85fd 2023-11-22 10:54:58,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/bc8b2432072e4e339f1a343538b439c7_SeqId_12_ 2023-11-22 10:54:58,570 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/2694e6dd2cd645699262d0422a2bf1b4; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700650498472; access_time=1700650497659; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,570 INFO [Listener at localhost/45227] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700650495931; access_time=1700650495113; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-22 10:54:58,585 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-22 10:54:58,686 INFO [Listener at localhost/45227] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-22 10:54:58,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-22 10:54:58,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:58,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650498698"}]},"ts":"1700650498698"} 2023-11-22 10:54:58,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-22 10:54:58,699 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-22 10:54:58,701 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-22 10:54:58,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, UNASSIGN}] 2023-11-22 10:54:58,703 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, UNASSIGN 2023-11-22 10:54:58,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1114ad4610722030e07a220babaa77d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:58,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700650498704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650498704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650498704"}]},"ts":"1700650498704"} 2023-11-22 10:54:58,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 1114ad4610722030e07a220babaa77d5, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:54:58,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-22 10:54:58,856 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:54:58,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1114ad4610722030e07a220babaa77d5, disabling compactions & flushes 2023-11-22 10:54:58,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. after waiting 0 ms 2023-11-22 10:54:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:58,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-22 10:54:58,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-22 10:54:58,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5. 2023-11-22 10:54:58,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1114ad4610722030e07a220babaa77d5: 2023-11-22 10:54:58,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:58,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1114ad4610722030e07a220babaa77d5, regionState=CLOSED 2023-11-22 10:54:58,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700650498864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650498864"}]},"ts":"1700650498864"} 2023-11-22 10:54:58,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=77, resume processing ppid=76 2023-11-22 10:54:58,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 1114ad4610722030e07a220babaa77d5, server=jenkins-hbase4.apache.org,46051,1700650400831 in 160 msec 2023-11-22 10:54:58,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=76, resume processing ppid=75 2023-11-22 10:54:58,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1114ad4610722030e07a220babaa77d5, UNASSIGN in 165 msec 2023-11-22 10:54:58,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650498868"}]},"ts":"1700650498868"} 2023-11-22 10:54:58,869 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-22 10:54:58,871 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-22 10:54:58,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 179 msec 2023-11-22 10:54:59,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-22 10:54:59,001 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-22 10:54:59,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-22 10:54:59,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,013 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,014 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-22 10:54:59,017 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:59,019 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1, FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/recovered.edits] 2023-11-22 10:54:59,023 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/2694e6dd2cd645699262d0422a2bf1b4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/2694e6dd2cd645699262d0422a2bf1b4 2023-11-22 10:54:59,024 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/f1/6076c48723de470fba85363be90690ca 2023-11-22 10:54:59,027 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/recovered.edits/15.seqid to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5/recovered.edits/15.seqid 2023-11-22 10:54:59,027 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testGetAfterCompaction/1114ad4610722030e07a220babaa77d5 2023-11-22 10:54:59,027 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-22 10:54:59,028 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-22 10:54:59,028 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-22 10:54:59,031 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311221985dc9b102b416db3d9820fc3970484 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311221985dc9b102b416db3d9820fc3970484 2023-11-22 10:54:59,032 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-22 10:54:59,034 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,055 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-22 10:54:59,057 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-22 10:54:59,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-22 10:54:59,058 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700650499058"}]},"ts":"9223372036854775807"} 2023-11-22 10:54:59,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-22 10:54:59,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1114ad4610722030e07a220babaa77d5, NAME => 'testGetAfterCompaction,,1700650492992.1114ad4610722030e07a220babaa77d5.', STARTKEY => '', ENDKEY => ''}] 2023-11-22 10:54:59,060 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-22 10:54:59,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700650499060"}]},"ts":"9223372036854775807"} 2023-11-22 10:54:59,061 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-22 10:54:59,064 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-22 10:54:59,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 57 msec 2023-11-22 10:54:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-22 10:54:59,117 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-22 10:54:59,132 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 244), OpenFileDescriptor=619 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 144) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 173), AvailableMemoryMB=9468 (was 9535) 2023-11-22 10:54:59,145 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=171, AvailableMemoryMB=9467 2023-11-22 10:54:59,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-22 10:54:59,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-22 10:54:59,151 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:54:59,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-22 10:54:59,151 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:54:59,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:54:59,161 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:54:59,161 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 empty. 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb empty. 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b empty. 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:54:59,162 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:54:59,163 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:54:59,163 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-22 10:54:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:54:59,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:54:59,577 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-22 10:54:59,579 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 89e8dba924da56cd9cec1acc7b8d626b, NAME => 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:59,579 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => d76ac5550387fe39ca7acfefe93c1f17, NAME => 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:59,579 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c46ba14b3f8784c8b72ead76fe7a78cb, NAME => 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 89e8dba924da56cd9cec1acc7b8d626b, disabling compactions & flushes 2023-11-22 10:54:59,586 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. after waiting 0 ms 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:54:59,586 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:54:59,586 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:54:59,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:54:59,986 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:59,986 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:54:59,986 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing d76ac5550387fe39ca7acfefe93c1f17, disabling compactions & flushes 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c46ba14b3f8784c8b72ead76fe7a78cb, disabling compactions & flushes 2023-11-22 10:54:59,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:54:59,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. after waiting 0 ms 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. after waiting 0 ms 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:54:59,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:54:59,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:54:59,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:54:59,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:54:59,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650499989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650499989"}]},"ts":"1700650499989"} 2023-11-22 10:54:59,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650499989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650499989"}]},"ts":"1700650499989"} 2023-11-22 10:54:59,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650499989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650499989"}]},"ts":"1700650499989"} 2023-11-22 10:54:59,991 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-22 10:54:59,992 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:54:59,992 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650499992"}]},"ts":"1700650499992"} 2023-11-22 10:54:59,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-22 10:54:59,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN}] 2023-11-22 10:54:59,999 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN 2023-11-22 10:54:59,999 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN 2023-11-22 10:54:59,999 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN 2023-11-22 10:54:59,999 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:54:59,999 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:00,000 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:00,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650500151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650500151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650500151"}]},"ts":"1700650500151"} 2023-11-22 10:55:00,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650500151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650500151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650500151"}]},"ts":"1700650500151"} 2023-11-22 10:55:00,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650500151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650500151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650500151"}]},"ts":"1700650500151"} 2023-11-22 10:55:00,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:00,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:00,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:00,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:55:00,307 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 89e8dba924da56cd9cec1acc7b8d626b, NAME => 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.', STARTKEY => '2', ENDKEY => ''} 2023-11-22 10:55:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,311 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,313 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:00,313 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:00,313 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89e8dba924da56cd9cec1acc7b8d626b columnFamilyName family1 2023-11-22 10:55:00,314 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(310): Store=89e8dba924da56cd9cec1acc7b8d626b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,314 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,315 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2 2023-11-22 10:55:00,315 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2 2023-11-22 10:55:00,316 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89e8dba924da56cd9cec1acc7b8d626b columnFamilyName family2 2023-11-22 10:55:00,317 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(310): Store=89e8dba924da56cd9cec1acc7b8d626b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:00,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:00,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:00,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 89e8dba924da56cd9cec1acc7b8d626b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62070272, jitterRate=-0.07508087158203125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:00,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:00,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., pid=83, masterSystemTime=1700650500307 2023-11-22 10:55:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:00,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:00,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d76ac5550387fe39ca7acfefe93c1f17, NAME => 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.', STARTKEY => '', ENDKEY => '1'} 2023-11-22 10:55:00,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:00,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650500324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650500324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650500324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650500324"}]},"ts":"1700650500324"} 2023-11-22 10:55:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,325 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,327 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:00,327 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:00,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=83, resume processing ppid=82 2023-11-22 10:55:00,327 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d76ac5550387fe39ca7acfefe93c1f17 columnFamilyName family1 2023-11-22 10:55:00,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831 in 172 msec 2023-11-22 10:55:00,328 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(310): Store=d76ac5550387fe39ca7acfefe93c1f17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,328 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN in 329 msec 2023-11-22 10:55:00,329 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2 2023-11-22 10:55:00,329 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2 2023-11-22 10:55:00,329 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d76ac5550387fe39ca7acfefe93c1f17 columnFamilyName family2 2023-11-22 10:55:00,330 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(310): Store=d76ac5550387fe39ca7acfefe93c1f17/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:00,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:00,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d76ac5550387fe39ca7acfefe93c1f17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64864486, jitterRate=-0.033443838357925415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:00,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., pid=84, masterSystemTime=1700650500307 2023-11-22 10:55:00,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:00,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:00,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:00,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c46ba14b3f8784c8b72ead76fe7a78cb, NAME => 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.', STARTKEY => '1', ENDKEY => '2'} 2023-11-22 10:55:00,337 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:00,338 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650500337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650500337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650500337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650500337"}]},"ts":"1700650500337"} 2023-11-22 10:55:00,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=84, resume processing ppid=80 2023-11-22 10:55:00,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831 in 185 msec 2023-11-22 10:55:00,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN in 344 msec 2023-11-22 10:55:00,347 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,348 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:00,348 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:00,348 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46ba14b3f8784c8b72ead76fe7a78cb columnFamilyName family1 2023-11-22 10:55:00,349 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(310): Store=c46ba14b3f8784c8b72ead76fe7a78cb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,349 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,350 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2 2023-11-22 10:55:00,350 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2 2023-11-22 10:55:00,351 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46ba14b3f8784c8b72ead76fe7a78cb columnFamilyName family2 2023-11-22 10:55:00,351 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(310): Store=c46ba14b3f8784c8b72ead76fe7a78cb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:00,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:00,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:00,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:00,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c46ba14b3f8784c8b72ead76fe7a78cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70558143, jitterRate=0.05139826238155365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:00,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:00,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., pid=85, masterSystemTime=1700650500307 2023-11-22 10:55:00,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:00,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:00,359 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:00,359 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650500359"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650500359"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650500359"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650500359"}]},"ts":"1700650500359"} 2023-11-22 10:55:00,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=85, resume processing ppid=81 2023-11-22 10:55:00,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831 in 206 msec 2023-11-22 10:55:00,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=81, resume processing ppid=79 2023-11-22 10:55:00,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN in 365 msec 2023-11-22 10:55:00,363 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:55:00,363 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650500363"}]},"ts":"1700650500363"} 2023-11-22 10:55:00,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-22 10:55:00,366 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:55:00,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2180 sec 2023-11-22 10:55:01,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-22 10:55:01,257 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-22 10:55:01,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:01,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:01,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:01,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:01,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-22 10:55:01,270 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-22 10:55:01,270 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:01,270 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-22 10:55:01,270 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-22 10:55:01,271 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:01,271 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:01,273 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:01,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:01,273 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:01,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:01,274 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:01,274 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:01,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:01,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:01,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-22 10:55:01,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-22 10:55:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-22 10:55:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-22 10:55:01,275 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:01,275 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:01,275 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:01,276 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:01,275 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:01,276 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:01,276 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89e8dba924da56cd9cec1acc7b8d626b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:01,276 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:01,277 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d76ac5550387fe39ca7acfefe93c1f17 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:01,277 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c46ba14b3f8784c8b72ead76fe7a78cb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:01,690 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e 2023-11-22 10:55:01,690 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 2023-11-22 10:55:01,690 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a 2023-11-22 10:55:02,096 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/05ebbe878c0241ada0c13c53262cb1c5 2023-11-22 10:55:02,096 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/de03e50b1add44fd8b75c0c9d06b7580 2023-11-22 10:55:02,096 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/28ad22cdbc1c44feb9654f9e20c5f0ad 2023-11-22 10:55:02,113 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630 2023-11-22 10:55:02,514 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4 2023-11-22 10:55:02,514 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5 2023-11-22 10:55:02,520 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/08fb9ad3c5a74448bcda2d75cc1aa464 2023-11-22 10:55:02,526 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/de03e50b1add44fd8b75c0c9d06b7580 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580 2023-11-22 10:55:02,530 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:02,531 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/08fb9ad3c5a74448bcda2d75cc1aa464 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464 2023-11-22 10:55:02,535 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:02,536 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 89e8dba924da56cd9cec1acc7b8d626b in 1260ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:02,536 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-22 10:55:02,536 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:02,536 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:02,921 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/b651422114e94feda57aff4411f707b1 2023-11-22 10:55:02,921 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/e67758c406524c1095b11e96be61fb02 2023-11-22 10:55:02,927 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/05ebbe878c0241ada0c13c53262cb1c5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5 2023-11-22 10:55:02,927 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/28ad22cdbc1c44feb9654f9e20c5f0ad as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad 2023-11-22 10:55:02,931 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:02,932 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/e67758c406524c1095b11e96be61fb02 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02 2023-11-22 10:55:02,932 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:02,933 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/b651422114e94feda57aff4411f707b1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1 2023-11-22 10:55:02,936 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:02,937 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:02,937 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c46ba14b3f8784c8b72ead76fe7a78cb in 1661ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:02,938 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:02,938 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:02,938 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:02,938 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d76ac5550387fe39ca7acfefe93c1f17 in 1661ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:02,938 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:02,938 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:02,938 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-22 10:55:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-22 10:55:02,940 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,940 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:02,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-22 10:55:02,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114ab3df[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:02,942 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-22 10:55:02,943 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,944 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,944 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-22 10:55:02,944 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-22 10:55:02,944 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:02,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,944 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:02,947 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-22 10:55:02,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:02,947 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:02,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-22 10:55:02,949 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-22 10:55:02,949 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:02,949 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:02,949 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-22 10:55:02,949 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:02,951 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,951 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:02,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,951 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:02,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:02,951 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,953 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:02,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:02,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-22 10:55:02,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:02,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:02,955 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:02,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:03,056 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:03,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:03,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:03,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:03,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:03,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:03,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:03,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-22 10:55:03,062 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-22 10:55:03,062 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:03,062 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-22 10:55:03,062 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-22 10:55:03,063 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:03,063 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:03,064 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:03,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:03,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:03,065 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:03,065 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:03,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:03,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:03,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:03,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:03,066 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-22 10:55:03,066 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-22 10:55:03,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-22 10:55:03,066 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-22 10:55:03,066 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:03,066 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-22 10:55:03,066 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:03,066 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:03,066 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:03,067 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:03,067 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89e8dba924da56cd9cec1acc7b8d626b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:03,067 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c46ba14b3f8784c8b72ead76fe7a78cb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:03,068 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:03,068 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:03,068 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d76ac5550387fe39ca7acfefe93c1f17 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:03,483 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 2023-11-22 10:55:03,487 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 2023-11-22 10:55:03,488 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a 2023-11-22 10:55:03,889 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/9db15ef5cfcf4cb99d05e377bca8076c 2023-11-22 10:55:03,892 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/273cbafec14e4652a2524dfdc613e78c 2023-11-22 10:55:03,894 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/fb6e7ceef26542178952e8d364a9e03d 2023-11-22 10:55:03,924 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731 2023-11-22 10:55:03,930 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/98b6006d1fe04014a3958520072dc4a4 2023-11-22 10:55:03,934 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/fb6e7ceef26542178952e8d364a9e03d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d 2023-11-22 10:55:03,938 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:03,939 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/98b6006d1fe04014a3958520072dc4a4 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4 2023-11-22 10:55:03,943 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:03,944 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d76ac5550387fe39ca7acfefe93c1f17 in 876ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:03,944 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:03,944 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:03,944 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:04,323 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e 2023-11-22 10:55:04,325 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0 2023-11-22 10:55:04,329 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/6eedb2d0780148b289c74d0c131b070e 2023-11-22 10:55:04,331 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/cf8dabfb8e874e7cb0f4f5040d437790 2023-11-22 10:55:04,338 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/9db15ef5cfcf4cb99d05e377bca8076c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c 2023-11-22 10:55:04,340 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/273cbafec14e4652a2524dfdc613e78c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c 2023-11-22 10:55:04,343 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:04,344 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/6eedb2d0780148b289c74d0c131b070e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e 2023-11-22 10:55:04,344 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:04,345 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/cf8dabfb8e874e7cb0f4f5040d437790 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790 2023-11-22 10:55:04,348 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:04,349 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:04,349 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c46ba14b3f8784c8b72ead76fe7a78cb in 1282ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:04,349 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:04,349 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:04,349 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 89e8dba924da56cd9cec1acc7b8d626b in 1282ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:04,349 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:04,349 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-22 10:55:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-22 10:55:04,357 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-22 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@574cc348[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:04,359 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-22 10:55:04,359 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,360 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,360 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-22 10:55:04,360 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-22 10:55:04,360 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,360 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:04,360 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:04,362 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,362 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-22 10:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:04,362 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:04,362 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-22 10:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,364 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:55:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:04,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-22 10:55:04,365 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-22 10:55:04,365 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:04,365 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:04,365 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-22 10:55:04,365 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:04,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:04,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:04,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,370 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:04,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,371 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:04,374 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:04,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-22 10:55:04,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:04,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-22 10:55:04,374 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:04,375 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:04,375 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:04,375 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:04,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:04,475 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:04,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:04,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:04,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:04,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:04,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:04,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-22 10:55:04,482 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-22 10:55:04,482 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:04,482 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-22 10:55:04,482 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-22 10:55:04,482 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,482 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:04,484 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:04,484 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:04,484 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:04,484 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:04,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:04,485 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-22 10:55:04,485 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-22 10:55:04,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-22 10:55:04,485 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-22 10:55:04,485 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:04,485 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-22 10:55:04,485 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:04,485 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:04,485 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:04,486 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89e8dba924da56cd9cec1acc7b8d626b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:04,486 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:04,486 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c46ba14b3f8784c8b72ead76fe7a78cb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:04,486 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:04,486 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:04,487 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:04,487 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:04,487 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d76ac5550387fe39ca7acfefe93c1f17 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:04,509 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 2023-11-22 10:55:04,903 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d 2023-11-22 10:55:04,906 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 2023-11-22 10:55:04,910 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/d8c28083098c413ea4c55d65e4321337 2023-11-22 10:55:04,914 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/81eef19593784a2daeade72315ad8859 2023-11-22 10:55:05,309 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 2023-11-22 10:55:05,323 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4 2023-11-22 10:55:05,336 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf 2023-11-22 10:55:05,723 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe 2023-11-22 10:55:05,727 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/801302aeb77d48f2ab1b47b0f76794cb 2023-11-22 10:55:05,728 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/22861dc50edc45cc98491be841de1b19 2023-11-22 10:55:05,731 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/d8c28083098c413ea4c55d65e4321337 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337 2023-11-22 10:55:05,732 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 2023-11-22 10:55:05,735 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:05,735 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:05,736 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/22861dc50edc45cc98491be841de1b19 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19 2023-11-22 10:55:05,736 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/801302aeb77d48f2ab1b47b0f76794cb as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb 2023-11-22 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/860b38449f53404da8f7278c5c01a7f8 2023-11-22 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c46ba14b3f8784c8b72ead76fe7a78cb in 1255ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 89e8dba924da56cd9cec1acc7b8d626b in 1255ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:05,742 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:05,742 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:05,742 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:05,742 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:05,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:05,742 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:05,745 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/81eef19593784a2daeade72315ad8859 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859 2023-11-22 10:55:05,748 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:05,749 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/860b38449f53404da8f7278c5c01a7f8 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8 2023-11-22 10:55:05,752 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:05,753 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d76ac5550387fe39ca7acfefe93c1f17 in 1266ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:05,753 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:05,753 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:05,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:05,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:05,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-22 10:55:05,753 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-22 10:55:05,755 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:05,756 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:05,756 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-22 10:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d2cbf7e[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:05,757 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-22 10:55:05,757 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,758 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-22 10:55:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-22 10:55:05,758 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,758 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:05,761 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,761 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-22 10:55:05,761 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:05,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,761 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-22 10:55:05,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:05,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:05,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-22 10:55:05,763 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-22 10:55:05,763 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:05,763 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:05,763 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-22 10:55:05,763 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:05,765 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,765 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:05,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,765 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:05,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:05,765 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,767 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:05,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-22 10:55:05,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:05,769 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:05,769 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:05,770 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:05,770 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:05,770 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:05,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:05,870 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:05,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:05,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:05,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:05,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:05,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:05,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:05,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-22 10:55:05,876 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-22 10:55:05,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:05,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-22 10:55:05,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-22 10:55:05,877 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,877 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:05,878 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,878 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:05,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:05,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:05,879 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:05,879 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:05,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:05,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:05,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:05,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:05,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-22 10:55:05,880 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-22 10:55:05,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-22 10:55:05,880 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-22 10:55:05,880 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:05,880 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:05,880 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:05,880 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:05,880 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89e8dba924da56cd9cec1acc7b8d626b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:05,880 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:05,880 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c46ba14b3f8784c8b72ead76fe7a78cb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:05,881 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d76ac5550387fe39ca7acfefe93c1f17 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:05,903 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 2023-11-22 10:55:06,298 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 2023-11-22 10:55:06,298 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f 2023-11-22 10:55:06,310 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/15691cefc2344af2adf77f2df2dad088 2023-11-22 10:55:06,703 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/a1f19273a26a4d1b83984301300e572d 2023-11-22 10:55:06,703 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/16c60db80bd943838f4b92e252fd566b 2023-11-22 10:55:06,722 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2 2023-11-22 10:55:07,119 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05 2023-11-22 10:55:07,119 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168 2023-11-22 10:55:07,126 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/1bb25d570aaf4de78e3ff551a076a53c 2023-11-22 10:55:07,130 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/15691cefc2344af2adf77f2df2dad088 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088 2023-11-22 10:55:07,133 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:07,134 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/1bb25d570aaf4de78e3ff551a076a53c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c 2023-11-22 10:55:07,137 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:07,138 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d76ac5550387fe39ca7acfefe93c1f17 in 1257ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:07,138 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:07,138 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:07,138 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:07,524 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/3bb74829358248dabab98ad4f30a3e22 2023-11-22 10:55:07,524 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/ea4c7b69820c4970b6c13cc1d14c6d22 2023-11-22 10:55:07,529 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/16c60db80bd943838f4b92e252fd566b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b 2023-11-22 10:55:07,529 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/a1f19273a26a4d1b83984301300e572d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d 2023-11-22 10:55:07,533 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:07,533 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:07,533 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/ea4c7b69820c4970b6c13cc1d14c6d22 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22 2023-11-22 10:55:07,534 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/3bb74829358248dabab98ad4f30a3e22 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22 2023-11-22 10:55:07,538 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:07,539 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:07,539 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 89e8dba924da56cd9cec1acc7b8d626b in 1659ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:07,539 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c46ba14b3f8784c8b72ead76fe7a78cb in 1659ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:07,539 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:07,539 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:07,539 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:07,540 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-22 10:55:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-22 10:55:07,541 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:07,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:07,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-22 10:55:07,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44956d11[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:07,544 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-22 10:55:07,544 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,545 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,545 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-22 10:55:07,545 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-22 10:55:07,545 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:07,545 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,545 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:07,548 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-22 10:55:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:07,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:07,548 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-22 10:55:07,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:07,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:07,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:07,551 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-22 10:55:07,551 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:07,551 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:07,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-22 10:55:07,551 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-22 10:55:07,551 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:07,553 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,553 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:07,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,553 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:07,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:07,554 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:07,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,555 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:07,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:07,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,557 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,557 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:07,557 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:07,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:07,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:07,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-22 10:55:07,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:07,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:07,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:07,558 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:07,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,558 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:07,559 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:07,658 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:07,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:07,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:07,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700650507669 (current time:1700650507669). 2023-11-22 10:55:07,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-22 10:55:07,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] zookeeper.ReadOnlyZKClient(139): Connect 0x0f5184c2 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:07,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f4f5fee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:07,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:07,683 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:07,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f5184c2 to 127.0.0.1:57046 2023-11-22 10:55:07,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:07,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-22 10:55:07,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:07,697 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot, current working dir path: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/snaptb-1700650507659 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-22 10:55:07,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:07,706 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:07,707 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700651107707 2023-11-22 10:55:07,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:07,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700650507659 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-22 10:55:07,708 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:07,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-22 10:55:07,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-22 10:55:07,710 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-22 10:55:07,711 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700651107711 2023-11-22 10:55:07,713 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:07,713 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-22 10:55:07,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700650507659 2023-11-22 10:55:07,722 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700650507659' 2023-11-22 10:55:07,722 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-22 10:55:07,722 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700650507659' starting 'acquire' 2023-11-22 10:55:07,722 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700650507659', kicking off acquire phase on members. 2023-11-22 10:55:07,723 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:07,723 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700650507659 2023-11-22 10:55:07,724 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-22 10:55:07,724 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-22 10:55:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-22 10:55:07,724 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,724 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700650507659 2023-11-22 10:55:07,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-22 10:55:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700650507659 2023-11-22 10:55:07,725 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700650507659 from table testCompactionWithHFileLink type FLUSH 2023-11-22 10:55:07,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700650507659 2023-11-22 10:55:07,727 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700650507659' with timeout 300000ms 2023-11-22 10:55:07,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-22 10:55:07,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700650507659' starting 'acquire' stage 2023-11-22 10:55:07,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700650507659' locally acquired 2023-11-22 10:55:07,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (snaptb-1700650507659) in zk 2023-11-22 10:55:07,729 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,729 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-22 10:55:07,730 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,730 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700650507659' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:07,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:07,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:07,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:07,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'snaptb-1700650507659' on coordinator 2023-11-22 10:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85fa17[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:07,731 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700650507659' starting 'in-barrier' execution. 2023-11-22 10:55:07,731 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,733 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:07,733 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700650507659' received 'reached' from coordinator. 2023-11-22 10:55:07,733 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:07,733 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:07,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-22 10:55:07,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:07,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:07,735 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.' region-info for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,735 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.' region-info for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,735 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.' region-info for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-22 10:55:07,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-22 10:55:07,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b] hfiles 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d] hfiles 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088] hfiles 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22] hfiles 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c] hfiles 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22] hfiles 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,748 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22 for snapshot=snaptb-1700650507659 2023-11-22 10:55:07,754 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. completed. 2023-11-22 10:55:07,755 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:07,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-22 10:55:07,813 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:07,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:07,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:07,817 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-22 10:55:08,018 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:08,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:08,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:08,019 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-22 10:55:08,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. completed. 2023-11-22 10:55:08,154 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-22 10:55:08,155 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. completed. 2023-11-22 10:55:08,155 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-22 10:55:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-22 10:55:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700650507659' locally completed 2023-11-22 10:55:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700650507659' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:08,157 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,157 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700650507659' has notified controller of completion 2023-11-22 10:55:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-22 10:55:08,157 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:08,157 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700650507659' completed. 2023-11-22 10:55:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:08,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:08,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700650507659' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:08,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'snaptb-1700650507659', counting down latch. Waiting for 0 more 2023-11-22 10:55:08,160 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700650507659' execution completed 2023-11-22 10:55:08,160 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:08,160 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:08,160 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700650507659 2023-11-22 10:55:08,160 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700650507659including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-22 10:55:08,161 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,162 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-22 10:55:08,162 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:08,162 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-22 10:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-22 10:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:08,163 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700650507659 2023-11-22 10:55:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700650507659 2023-11-22 10:55:08,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-22 10:55:08,167 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:08,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1700650507659 because node does not exist (not an error) 2023-11-22 10:55:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700650507659/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700650507659 2023-11-22 10:55:08,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-22 10:55:08,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-22 10:55:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-22 10:55:08,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325] mob files 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a 2023-11-22 10:55:08,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731] mob files 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf 2023-11-22 10:55:08,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731 2023-11-22 10:55:08,319 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:08,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:08,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:08,320 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-22 10:55:08,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700650507659 2023-11-22 10:55:08,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/snaptb-1700650507659 2023-11-22 10:55:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/snaptb-1700650507659 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/snaptb-1700650507659 2023-11-22 10:55:08,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700650507659 of table testCompactionWithHFileLink completed 2023-11-22 10:55:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/snaptb-1700650507659 2023-11-22 10:55:08,632 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/snaptb-1700650507659 2023-11-22 10:55:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700650507659 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700650507707Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700650508575 (+868 ms)Consolidate snapshot: snaptb-1700650507659 at 1700650508575Loading Region manifests for snaptb-1700650507659 at 1700650508575Writing data manifest for snaptb-1700650507659 at 1700650508586 (+11 ms)Verifying snapshot: snaptb-1700650507659 at 1700650508602 (+16 ms)Snapshot snaptb-1700650507659 of table testCompactionWithHFileLink completed at 1700650508631 (+29 ms) 2023-11-22 10:55:08,634 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-22 10:55:08,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 925 msec 2023-11-22 10:55:08,820 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:08,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:08,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-22 10:55:08,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:08,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:08,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-22 10:55:08,871 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-22 10:55:08,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:08,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-22 10:55:08,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-22 10:55:08,872 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:08,872 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:08,873 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:08,873 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:08,874 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:08,874 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:08,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:08,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-22 10:55:08,875 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-22 10:55:08,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-22 10:55:08,875 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-22 10:55:08,875 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:08,875 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-22 10:55:08,876 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:08,876 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:08,876 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. started... 2023-11-22 10:55:08,876 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. started... 2023-11-22 10:55:08,877 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89e8dba924da56cd9cec1acc7b8d626b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:08,877 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c46ba14b3f8784c8b72ead76fe7a78cb 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:08,877 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:08,877 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. started... 2023-11-22 10:55:08,877 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d76ac5550387fe39ca7acfefe93c1f17 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:09,299 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/d9188d1e41cb477eb78fafd3041383d9 2023-11-22 10:55:09,303 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9188d1e41cb477eb78fafd3041383d9 2023-11-22 10:55:09,698 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/dbc3f98913bc4718bfe239e0aacb1155 2023-11-22 10:55:09,699 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/f26ce7e004714e019c583c71fca74639 2023-11-22 10:55:09,703 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc3f98913bc4718bfe239e0aacb1155 2023-11-22 10:55:09,703 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f26ce7e004714e019c583c71fca74639 2023-11-22 10:55:10,134 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/ebed986a70be47a688aa8fe59f17e374 2023-11-22 10:55:10,138 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/0990a22245f94512805ec93fa9520f11 2023-11-22 10:55:10,139 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebed986a70be47a688aa8fe59f17e374 2023-11-22 10:55:10,140 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/d9188d1e41cb477eb78fafd3041383d9 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9 2023-11-22 10:55:10,142 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0990a22245f94512805ec93fa9520f11 2023-11-22 10:55:10,143 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/f26ce7e004714e019c583c71fca74639 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639 2023-11-22 10:55:10,144 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9188d1e41cb477eb78fafd3041383d9 2023-11-22 10:55:10,144 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9, entries=3, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,146 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/ebed986a70be47a688aa8fe59f17e374 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374 2023-11-22 10:55:10,148 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f26ce7e004714e019c583c71fca74639 2023-11-22 10:55:10,148 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639, entries=3, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,149 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/0990a22245f94512805ec93fa9520f11 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11 2023-11-22 10:55:10,149 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebed986a70be47a688aa8fe59f17e374 2023-11-22 10:55:10,150 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374, entries=1, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,150 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d76ac5550387fe39ca7acfefe93c1f17 in 1273ms, sequenceid=24, compaction requested=true 2023-11-22 10:55:10,150 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:10,150 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:10,150 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:10,152 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0990a22245f94512805ec93fa9520f11 2023-11-22 10:55:10,153 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11, entries=1, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,153 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c46ba14b3f8784c8b72ead76fe7a78cb in 1276ms, sequenceid=24, compaction requested=true 2023-11-22 10:55:10,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:10,153 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:10,153 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:10,540 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/1333a9cef1dc40a3b8a6da7634c096c4 2023-11-22 10:55:10,545 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1333a9cef1dc40a3b8a6da7634c096c4 2023-11-22 10:55:10,546 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/dbc3f98913bc4718bfe239e0aacb1155 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155 2023-11-22 10:55:10,552 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc3f98913bc4718bfe239e0aacb1155 2023-11-22 10:55:10,552 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155, entries=3, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,553 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/1333a9cef1dc40a3b8a6da7634c096c4 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4 2023-11-22 10:55:10,558 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1333a9cef1dc40a3b8a6da7634c096c4 2023-11-22 10:55:10,558 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4, entries=1, sequenceid=24, filesize=5.0 K 2023-11-22 10:55:10,559 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 89e8dba924da56cd9cec1acc7b8d626b in 1682ms, sequenceid=24, compaction requested=true 2023-11-22 10:55:10,559 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:10,559 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:10,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:10,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:10,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-22 10:55:10,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-22 10:55:10,561 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,561 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:10,561 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:10,561 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:10,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-22 10:55:10,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31623fcc[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:10,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-22 10:55:10,563 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,565 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-22 10:55:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-22 10:55:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:10,565 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,565 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:10,567 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-22 10:55:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:10,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:10,567 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-22 10:55:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:10,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-22 10:55:10,570 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-22 10:55:10,570 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:10,570 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:10,570 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-22 10:55:10,570 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:10,572 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,572 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:10,572 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:10,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:10,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,574 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-22 10:55:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,584 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-22 10:55:10,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-22 10:55:10,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:10,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:10,585 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:10,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:10,585 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:10,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:10,686 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:10,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:10,687 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:10,687 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 89e8dba924da56cd9cec1acc7b8d626b/family1 is initiating major compaction (all files) 2023-11-22 10:55:10,687 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:10,687 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:10,688 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 89e8dba924da56cd9cec1acc7b8d626b/family1 in testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:10,688 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp, totalSize=26.7 K 2023-11-22 10:55:10,688 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting de03e50b1add44fd8b75c0c9d06b7580, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501266 2023-11-22 10:55:10,689 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 273cbafec14e4652a2524dfdc613e78c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:10,689 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting f0c06e8857ea4b34a08d88e5dc1fd2d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504478 2023-11-22 10:55:10,690 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 16c60db80bd943838f4b92e252fd566b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:10,690 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting dbc3f98913bc4718bfe239e0aacb1155, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:10,702 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 89e8dba924da56cd9cec1acc7b8d626b#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:11,110 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del 2023-11-22 10:55:11,110 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del 2023-11-22 10:55:11,924 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf9058f8fd034eb4a9b1ff990877ac60 2023-11-22 10:55:11,925 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/cf9058f8fd034eb4a9b1ff990877ac60 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cf9058f8fd034eb4a9b1ff990877ac60 2023-11-22 10:55:11,928 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf9058f8fd034eb4a9b1ff990877ac60 2023-11-22 10:55:11,929 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89e8dba924da56cd9cec1acc7b8d626b/family1 of 89e8dba924da56cd9cec1acc7b8d626b into cf9058f8fd034eb4a9b1ff990877ac60(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:11,929 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:11,929 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:11,930 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 89e8dba924da56cd9cec1acc7b8d626b/family2 is initiating major compaction (all files) 2023-11-22 10:55:11,930 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:11,930 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:11,930 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 89e8dba924da56cd9cec1acc7b8d626b/family2 in testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:11,930 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp, totalSize=25.4 K 2023-11-22 10:55:11,931 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 08fb9ad3c5a74448bcda2d75cc1aa464, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501266 2023-11-22 10:55:11,931 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting cf8dabfb8e874e7cb0f4f5040d437790, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:11,931 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 22861dc50edc45cc98491be841de1b19, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504478 2023-11-22 10:55:11,932 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting ea4c7b69820c4970b6c13cc1d14c6d22, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:11,932 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 1333a9cef1dc40a3b8a6da7634c096c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:11,943 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 89e8dba924da56cd9cec1acc7b8d626b#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:11,950 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del 2023-11-22 10:55:11,950 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del 2023-11-22 10:55:12,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155] to archive 2023-11-22 10:55:12,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:12,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/de03e50b1add44fd8b75c0c9d06b7580 2023-11-22 10:55:12,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/273cbafec14e4652a2524dfdc613e78c 2023-11-22 10:55:12,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/f0c06e8857ea4b34a08d88e5dc1fd2d6 2023-11-22 10:55:12,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/16c60db80bd943838f4b92e252fd566b 2023-11-22 10:55:12,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/dbc3f98913bc4718bfe239e0aacb1155 2023-11-22 10:55:12,764 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8067a3d341074a279033477c642a4a5b 2023-11-22 10:55:12,765 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/8067a3d341074a279033477c642a4a5b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/8067a3d341074a279033477c642a4a5b 2023-11-22 10:55:12,769 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8067a3d341074a279033477c642a4a5b 2023-11-22 10:55:12,770 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89e8dba924da56cd9cec1acc7b8d626b/family2 of 89e8dba924da56cd9cec1acc7b8d626b into 8067a3d341074a279033477c642a4a5b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:12,770 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:12,770 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:12,770 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): c46ba14b3f8784c8b72ead76fe7a78cb/family1 is initiating major compaction (all files) 2023-11-22 10:55:12,771 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:12,771 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:12,771 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of c46ba14b3f8784c8b72ead76fe7a78cb/family1 in testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:12,771 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp, totalSize=26.7 K 2023-11-22 10:55:12,771 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 05ebbe878c0241ada0c13c53262cb1c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501265 2023-11-22 10:55:12,772 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 9db15ef5cfcf4cb99d05e377bca8076c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:12,772 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting d8c28083098c413ea4c55d65e4321337, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:12,772 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a1f19273a26a4d1b83984301300e572d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:12,773 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting f26ce7e004714e019c583c71fca74639, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:12,785 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): c46ba14b3f8784c8b72ead76fe7a78cb#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:12,801 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del 2023-11-22 10:55:12,801 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del 2023-11-22 10:55:12,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4] to archive 2023-11-22 10:55:12,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:12,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/08fb9ad3c5a74448bcda2d75cc1aa464 2023-11-22 10:55:12,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/cf8dabfb8e874e7cb0f4f5040d437790 2023-11-22 10:55:12,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/22861dc50edc45cc98491be841de1b19 2023-11-22 10:55:12,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/ea4c7b69820c4970b6c13cc1d14c6d22 2023-11-22 10:55:12,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/1333a9cef1dc40a3b8a6da7634c096c4 2023-11-22 10:55:13,624 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dca3beca4aa14e329f7c51b906cb23d6 2023-11-22 10:55:13,625 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/dca3beca4aa14e329f7c51b906cb23d6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dca3beca4aa14e329f7c51b906cb23d6 2023-11-22 10:55:13,630 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dca3beca4aa14e329f7c51b906cb23d6 2023-11-22 10:55:13,631 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c46ba14b3f8784c8b72ead76fe7a78cb/family1 of c46ba14b3f8784c8b72ead76fe7a78cb into dca3beca4aa14e329f7c51b906cb23d6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:13,632 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:13,632 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:13,632 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): c46ba14b3f8784c8b72ead76fe7a78cb/family2 is initiating major compaction (all files) 2023-11-22 10:55:13,632 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:13,632 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:13,632 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of c46ba14b3f8784c8b72ead76fe7a78cb/family2 in testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:13,632 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp, totalSize=25.4 K 2023-11-22 10:55:13,633 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting e67758c406524c1095b11e96be61fb02, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501265 2023-11-22 10:55:13,633 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 6eedb2d0780148b289c74d0c131b070e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:13,634 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 801302aeb77d48f2ab1b47b0f76794cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:13,634 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 3bb74829358248dabab98ad4f30a3e22, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:13,635 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 0990a22245f94512805ec93fa9520f11, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:13,653 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): c46ba14b3f8784c8b72ead76fe7a78cb#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:13,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639] to archive 2023-11-22 10:55:13,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:13,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/05ebbe878c0241ada0c13c53262cb1c5 2023-11-22 10:55:13,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/9db15ef5cfcf4cb99d05e377bca8076c 2023-11-22 10:55:13,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/d8c28083098c413ea4c55d65e4321337 2023-11-22 10:55:13,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/a1f19273a26a4d1b83984301300e572d 2023-11-22 10:55:13,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/f26ce7e004714e019c583c71fca74639 2023-11-22 10:55:14,070 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del 2023-11-22 10:55:14,070 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del 2023-11-22 10:55:14,487 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bba7aa65c1f4865807b5b4734b7715f 2023-11-22 10:55:14,488 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/6bba7aa65c1f4865807b5b4734b7715f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6bba7aa65c1f4865807b5b4734b7715f 2023-11-22 10:55:14,492 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bba7aa65c1f4865807b5b4734b7715f 2023-11-22 10:55:14,494 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c46ba14b3f8784c8b72ead76fe7a78cb/family2 of c46ba14b3f8784c8b72ead76fe7a78cb into 6bba7aa65c1f4865807b5b4734b7715f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:14,494 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:14,494 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:14,494 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): d76ac5550387fe39ca7acfefe93c1f17/family1 is initiating major compaction (all files) 2023-11-22 10:55:14,494 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:14,494 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:14,495 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of d76ac5550387fe39ca7acfefe93c1f17/family1 in testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:14,495 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp, totalSize=26.7 K 2023-11-22 10:55:14,495 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 28ad22cdbc1c44feb9654f9e20c5f0ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501264 2023-11-22 10:55:14,496 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting fb6e7ceef26542178952e8d364a9e03d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503057 2023-11-22 10:55:14,496 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 81eef19593784a2daeade72315ad8859, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:14,497 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 15691cefc2344af2adf77f2df2dad088, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:14,497 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting d9188d1e41cb477eb78fafd3041383d9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:14,509 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): d76ac5550387fe39ca7acfefe93c1f17#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:14,518 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del 2023-11-22 10:55:14,518 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del 2023-11-22 10:55:14,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11] to archive 2023-11-22 10:55:14,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:14,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/e67758c406524c1095b11e96be61fb02 2023-11-22 10:55:14,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6eedb2d0780148b289c74d0c131b070e 2023-11-22 10:55:14,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/801302aeb77d48f2ab1b47b0f76794cb 2023-11-22 10:55:14,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/3bb74829358248dabab98ad4f30a3e22 2023-11-22 10:55:14,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/0990a22245f94512805ec93fa9520f11 2023-11-22 10:55:14,950 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f6aa6f5af96472bafafe383894b2ba8 2023-11-22 10:55:14,950 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/2f6aa6f5af96472bafafe383894b2ba8 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/2f6aa6f5af96472bafafe383894b2ba8 2023-11-22 10:55:14,954 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f6aa6f5af96472bafafe383894b2ba8 2023-11-22 10:55:14,955 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d76ac5550387fe39ca7acfefe93c1f17/family1 of d76ac5550387fe39ca7acfefe93c1f17 into 2f6aa6f5af96472bafafe383894b2ba8(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:14,955 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:14,955 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:14,955 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): d76ac5550387fe39ca7acfefe93c1f17/family2 is initiating major compaction (all files) 2023-11-22 10:55:14,956 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:14,956 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:14,956 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of d76ac5550387fe39ca7acfefe93c1f17/family2 in testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:14,957 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp, totalSize=25.4 K 2023-11-22 10:55:14,957 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting b651422114e94feda57aff4411f707b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501264 2023-11-22 10:55:14,957 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 98b6006d1fe04014a3958520072dc4a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503057 2023-11-22 10:55:14,958 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 860b38449f53404da8f7278c5c01a7f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:14,958 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 1bb25d570aaf4de78e3ff551a076a53c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:14,958 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting ebed986a70be47a688aa8fe59f17e374, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-22 10:55:14,971 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): d76ac5550387fe39ca7acfefe93c1f17#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:15,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9] to archive 2023-11-22 10:55:15,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:15,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/28ad22cdbc1c44feb9654f9e20c5f0ad 2023-11-22 10:55:15,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fb6e7ceef26542178952e8d364a9e03d 2023-11-22 10:55:15,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/81eef19593784a2daeade72315ad8859 2023-11-22 10:55:15,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/15691cefc2344af2adf77f2df2dad088 2023-11-22 10:55:15,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d9188d1e41cb477eb78fafd3041383d9 2023-11-22 10:55:15,381 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del 2023-11-22 10:55:15,381 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del 2023-11-22 10:55:16,198 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66662f82228c4693b52ab1e9ed478211 2023-11-22 10:55:16,198 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/66662f82228c4693b52ab1e9ed478211 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/66662f82228c4693b52ab1e9ed478211 2023-11-22 10:55:16,203 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66662f82228c4693b52ab1e9ed478211 2023-11-22 10:55:16,204 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d76ac5550387fe39ca7acfefe93c1f17/family2 of d76ac5550387fe39ca7acfefe93c1f17 into 66662f82228c4693b52ab1e9ed478211(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:16,204 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:16,209 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:16,213 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:16,219 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:16,220 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:16,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374] to archive 2023-11-22 10:55:16,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:16,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/b651422114e94feda57aff4411f707b1 2023-11-22 10:55:16,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/98b6006d1fe04014a3958520072dc4a4 2023-11-22 10:55:16,229 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:55:16,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/860b38449f53404da8f7278c5c01a7f8 2023-11-22 10:55:16,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/1bb25d570aaf4de78e3ff551a076a53c 2023-11-22 10:55:16,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/ebed986a70be47a688aa8fe59f17e374 2023-11-22 10:55:16,266 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-22 10:55:16,270 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del 2023-11-22 10:55:16,273 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del 2023-11-22 10:55:16,283 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del 2023-11-22 10:55:16,284 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:16,285 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(139): Connect 0x14921606 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:16,290 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bf87a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:16,290 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:16,290 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:16,290 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:16,371 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3 2023-11-22 10:55:16,372 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:16,386 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:16,389 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:16,396 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:55:16,397 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:55:16,407 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/e086d05dd30949a3896670b3a5ab60c5 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-22 10:55:16,407 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/e086d05dd30949a3896670b3a5ab60c5}] 2023-11-22 10:55:16,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/e086d05dd30949a3896670b3a5ab60c5 for inclusion in c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:16,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-22 10:55:16,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-22 10:55:16,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:16,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/e086d05dd30949a3896670b3a5ab60c5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4co6nmu1ecmbmelc9s3bi4rr7fcjjcbmk3b7croqfnqje5vcs4la1eigq10j968v/family1/e086d05dd30949a3896670b3a5ab60c5 2023-11-22 10:55:16,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4co6nmu1ecmbmelc9s3bi4rr7fcjjcbmk3b7croqfnqje5vcs4la1eigq10j968v/family1/e086d05dd30949a3896670b3a5ab60c5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ 2023-11-22 10:55:16,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4co6nmu1ecmbmelc9s3bi4rr7fcjjcbmk3b7croqfnqje5vcs4la1eigq10j968v/family1/e086d05dd30949a3896670b3a5ab60c5 into c46ba14b3f8784c8b72ead76fe7a78cb/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ - updating store file list. 2023-11-22 10:55:16,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ into c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:16,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4co6nmu1ecmbmelc9s3bi4rr7fcjjcbmk3b7croqfnqje5vcs4la1eigq10j968v/family1/e086d05dd30949a3896670b3a5ab60c5 into c46ba14b3f8784c8b72ead76fe7a78cb/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_) 2023-11-22 10:55:16,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4co6nmu1ecmbmelc9s3bi4rr7fcjjcbmk3b7croqfnqje5vcs4la1eigq10j968v/family1/e086d05dd30949a3896670b3a5ab60c5 2023-11-22 10:55:16,424 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:16,424 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:16,426 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 2023-11-22 10:55:16,427 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 2023-11-22 10:55:16,428 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 2023-11-22 10:55:16,429 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 2023-11-22 10:55:16,429 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:16,429 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122' 2023-11-22 10:55:16,430 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:17,167 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575 2023-11-22 10:55:17,168 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:17,180 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c 2023-11-22 10:55:17,181 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:17,202 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b3b0bf44abae4032854d9a647fdcd9cf first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-22 10:55:17,204 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b3b0bf44abae4032854d9a647fdcd9cf}] 2023-11-22 10:55:17,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b3b0bf44abae4032854d9a647fdcd9cf for inclusion in 89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:17,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-22 10:55:17,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-22 10:55:17,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b3b0bf44abae4032854d9a647fdcd9cf to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4gr12a2ibs5hei1pce1d7kbv0ifivks13b3mciq6kcbprqj3scvddodlb50sqo1q/family1/b3b0bf44abae4032854d9a647fdcd9cf 2023-11-22 10:55:17,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4gr12a2ibs5hei1pce1d7kbv0ifivks13b3mciq6kcbprqj3scvddodlb50sqo1q/family1/b3b0bf44abae4032854d9a647fdcd9cf as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ 2023-11-22 10:55:17,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4gr12a2ibs5hei1pce1d7kbv0ifivks13b3mciq6kcbprqj3scvddodlb50sqo1q/family1/b3b0bf44abae4032854d9a647fdcd9cf into 89e8dba924da56cd9cec1acc7b8d626b/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ - updating store file list. 2023-11-22 10:55:17,216 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/575f0b95905a4debb09ef95c1592cbc5 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-22 10:55:17,216 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/575f0b95905a4debb09ef95c1592cbc5}] 2023-11-22 10:55:17,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ into 89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:17,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4gr12a2ibs5hei1pce1d7kbv0ifivks13b3mciq6kcbprqj3scvddodlb50sqo1q/family1/b3b0bf44abae4032854d9a647fdcd9cf into 89e8dba924da56cd9cec1acc7b8d626b/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_) 2023-11-22 10:55:17,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/575f0b95905a4debb09ef95c1592cbc5 for inclusion in d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:17,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__4gr12a2ibs5hei1pce1d7kbv0ifivks13b3mciq6kcbprqj3scvddodlb50sqo1q/family1/b3b0bf44abae4032854d9a647fdcd9cf 2023-11-22 10:55:17,222 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:17,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-22 10:55:17,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-22 10:55:17,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:17,222 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:17,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/575f0b95905a4debb09ef95c1592cbc5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__kokmel3lit4mn6i71r9eii358khbf5bsn8bo9mop8j1ghftbhevv1njcb5rqf82o/family1/575f0b95905a4debb09ef95c1592cbc5 2023-11-22 10:55:17,225 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e 2023-11-22 10:55:17,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__kokmel3lit4mn6i71r9eii358khbf5bsn8bo9mop8j1ghftbhevv1njcb5rqf82o/family1/575f0b95905a4debb09ef95c1592cbc5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ 2023-11-22 10:55:17,227 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 2023-11-22 10:55:17,227 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__kokmel3lit4mn6i71r9eii358khbf5bsn8bo9mop8j1ghftbhevv1njcb5rqf82o/family1/575f0b95905a4debb09ef95c1592cbc5 into d76ac5550387fe39ca7acfefe93c1f17/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ - updating store file list. 2023-11-22 10:55:17,228 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f 2023-11-22 10:55:17,229 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d 2023-11-22 10:55:17,229 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:17,229 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122' 2023-11-22 10:55:17,230 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:17,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ into d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:17,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__kokmel3lit4mn6i71r9eii358khbf5bsn8bo9mop8j1ghftbhevv1njcb5rqf82o/family1/575f0b95905a4debb09ef95c1592cbc5 into d76ac5550387fe39ca7acfefe93c1f17/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_) 2023-11-22 10:55:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__kokmel3lit4mn6i71r9eii358khbf5bsn8bo9mop8j1ghftbhevv1njcb5rqf82o/family1/575f0b95905a4debb09ef95c1592cbc5 2023-11-22 10:55:17,233 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:17,233 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:17,235 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a 2023-11-22 10:55:17,236 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 2023-11-22 10:55:17,237 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a 2023-11-22 10:55:17,238 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 2023-11-22 10:55:17,238 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:17,238 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122' 2023-11-22 10:55:17,238 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:17,238 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:17,238 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:17,238 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del] 2023-11-22 10:55:17,239 DEBUG [Listener at localhost/45227] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:17,240 DEBUG [Listener at localhost/45227] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122196e0a5306fc43ee82e18cdc8405cdf9_del 2023-11-22 10:55:17,240 INFO [Listener at localhost/45227] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-22 10:55:17,240 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del] 2023-11-22 10:55:17,240 DEBUG [Listener at localhost/45227] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:17,242 DEBUG [Listener at localhost/45227] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122c1c79ea9695c42c08c319ef6c146039d_del 2023-11-22 10:55:17,242 INFO [Listener at localhost/45227] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-22 10:55:17,242 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del] 2023-11-22 10:55:17,242 DEBUG [Listener at localhost/45227] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:17,244 DEBUG [Listener at localhost/45227] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311225c462461dc924ccdb3a21ace9a1ae2a6_del 2023-11-22 10:55:17,244 INFO [Listener at localhost/45227] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-22 10:55:17,246 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:17,249 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:17,253 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:17,254 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:17,260 INFO [Listener at localhost/45227] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-22 10:55:17,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-22 10:55:17,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-22 10:55:17,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-22 10:55:17,263 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650517263"}]},"ts":"1700650517263"} 2023-11-22 10:55:17,264 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-22 10:55:17,266 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-22 10:55:17,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, UNASSIGN}] 2023-11-22 10:55:17,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, UNASSIGN 2023-11-22 10:55:17,268 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, UNASSIGN 2023-11-22 10:55:17,268 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, UNASSIGN 2023-11-22 10:55:17,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:17,269 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:17,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650517269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650517269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650517269"}]},"ts":"1700650517269"} 2023-11-22 10:55:17,269 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650517269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650517269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650517269"}]},"ts":"1700650517269"} 2023-11-22 10:55:17,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:17,270 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650517269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650517269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650517269"}]},"ts":"1700650517269"} 2023-11-22 10:55:17,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:17,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:17,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:17,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-22 10:55:17,422 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:17,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:17,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d76ac5550387fe39ca7acfefe93c1f17, disabling compactions & flushes 2023-11-22 10:55:17,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:17,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:17,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. after waiting 0 ms 2023-11-22 10:55:17,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:17,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-22 10:55:17,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:17,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:17,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:17,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:17,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 89e8dba924da56cd9cec1acc7b8d626b, disabling compactions & flushes 2023-11-22 10:55:17,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:17,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:17,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. after waiting 0 ms 2023-11-22 10:55:17,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:17,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=CLOSED 2023-11-22 10:55:17,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650517430"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650517430"}]},"ts":"1700650517430"} 2023-11-22 10:55:17,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=92, resume processing ppid=89 2023-11-22 10:55:17,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831 in 161 msec 2023-11-22 10:55:17,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-22 10:55:17,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, UNASSIGN in 167 msec 2023-11-22 10:55:17,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:17,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:17,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:17,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:17,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c46ba14b3f8784c8b72ead76fe7a78cb, disabling compactions & flushes 2023-11-22 10:55:17,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:17,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:17,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. after waiting 0 ms 2023-11-22 10:55:17,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=CLOSED 2023-11-22 10:55:17,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:17,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650517437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650517437"}]},"ts":"1700650517437"} 2023-11-22 10:55:17,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=94, resume processing ppid=91 2023-11-22 10:55:17,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831 in 166 msec 2023-11-22 10:55:17,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, UNASSIGN in 173 msec 2023-11-22 10:55:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-22 10:55:17,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:17,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:17,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:17,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=CLOSED 2023-11-22 10:55:17,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650517444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650517444"}]},"ts":"1700650517444"} 2023-11-22 10:55:17,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=93, resume processing ppid=90 2023-11-22 10:55:17,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831 in 173 msec 2023-11-22 10:55:17,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=90, resume processing ppid=88 2023-11-22 10:55:17,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, UNASSIGN in 179 msec 2023-11-22 10:55:17,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650517448"}]},"ts":"1700650517448"} 2023-11-22 10:55:17,449 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-22 10:55:17,451 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-22 10:55:17,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 191 msec 2023-11-22 10:55:17,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-22 10:55:17,565 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-22 10:55:17,577 INFO [Listener at localhost/45227] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:17,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700650517578 (current time:1700650517578). 2023-11-22 10:55:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-22 10:55:17,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] zookeeper.ReadOnlyZKClient(139): Connect 0x4dde9e88 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:17,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33779825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:17,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:17,587 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:17,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dde9e88 to 127.0.0.1:57046 2023-11-22 10:55:17,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:17,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-22 10:55:17,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:17,591 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot, current working dir path: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700650507659-1700650517577 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-22 10:55:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:17,595 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:17,595 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700651117595 2023-11-22 10:55:17,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700650507659-1700650517577 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-22 10:55:17,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:17,596 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:17,596 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-22 10:55:17,696 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:17,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:17,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:17,698 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-22 10:55:17,898 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:17,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:17,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:17,899 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-22 10:55:18,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-22 10:55:18,008 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-22 10:55:18,008 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-22 10:55:18,009 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-22 10:55:18,011 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/2f6aa6f5af96472bafafe383894b2ba8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_] hfiles 2023-11-22 10:55:18,012 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/2f6aa6f5af96472bafafe383894b2ba8 2023-11-22 10:55:18,012 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ 2023-11-22 10:55:18,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c] hfiles 2023-11-22 10:55:18,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3 2023-11-22 10:55:18,012 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cf9058f8fd034eb4a9b1ff990877ac60] hfiles 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/66662f82228c4693b52ab1e9ed478211] hfiles 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/66662f82228c4693b52ab1e9ed478211 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cf9058f8fd034eb4a9b1ff990877ac60 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dca3beca4aa14e329f7c51b906cb23d6] hfiles 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ 2023-11-22 10:55:18,013 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dca3beca4aa14e329f7c51b906cb23d6 2023-11-22 10:55:18,014 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/8067a3d341074a279033477c642a4a5b] hfiles 2023-11-22 10:55:18,014 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/8067a3d341074a279033477c642a4a5b 2023-11-22 10:55:18,016 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6bba7aa65c1f4865807b5b4734b7715f] hfiles 2023-11-22 10:55:18,016 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6bba7aa65c1f4865807b5b4734b7715f 2023-11-22 10:55:18,020 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731] hfiles 2023-11-22 10:55:18,020 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112203078ed57b754c6f80c71ece172d835e 2023-11-22 10:55:18,020 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311228d8e05b521604d54bdab659be1ab3cb4 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122ad4c503fe75c49f8825092a3622163e5 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231122dd765d26735f40d890805c2f3f5dc168 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311220d91d8e9154244c99a854c67038fa630 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311226742d9e26f364caeb2976420fe13dd05 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c0e7a6e260054e8dae8d67b6e8803ba0 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231122c3119f5572234505b8e68b480a941cfe 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112233eec046439e4da1afc26b5e632073c4 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311224f7a80ed2369474798a6f5881b9bf3d2 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228075a1327a554359a688b7beb3e1eabf 2023-11-22 10:55:18,021 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311228641f3286a754c23b0ca0b10ff66c731 2023-11-22 10:55:18,200 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:18,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:18,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:18,201 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-22 10:55:18,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-22 10:55:18,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:18,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:18,701 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-22 10:55:18,703 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-22 10:55:18,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700650507659-1700650517577 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:18,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700650507659-1700650517577 of table testCompactionWithHFileLink completed 2023-11-22 10:55:18,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:18,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:18,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700650507659-1700650517577 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700650517595Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700650518004 (+409 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700650507659-1700650517577 at 1700650518434 (+430 ms)Loading Region manifests for hbase-failsafe-snaptb-1700650507659-1700650517577 at 1700650518434Writing data manifest for hbase-failsafe-snaptb-1700650507659-1700650517577 at 1700650518437 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1700650507659-1700650517577 at 1700650518844 (+407 ms)Snapshot hbase-failsafe-snaptb-1700650507659-1700650517577 of table testCompactionWithHFileLink completed at 1700650518870 (+26 ms) 2023-11-22 10:55:18,872 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-22 10:55:18,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2790 sec 2023-11-22 10:55:19,703 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-22 10:55:19,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-22 10:55:19,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700650507659-1700650517577 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-22 10:55:19,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700650507659" table: "testCompactionWithHFileLink" creation_time: 1700650507669 type: FLUSH version: 2 ttl: 0 ) 2023-11-22 10:55:19,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700650507659 as table=testCompactionWithHFileLink 2023-11-22 10:55:19,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-22 10:55:19,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-22 10:55:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-22 10:55:20,160 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-22 10:55:20,161 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-22 10:55:20,161 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-22 10:55:20,162 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-22 10:55:20,167 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700650507659" table: "testCompactionWithHFileLink" creation_time: 1700650507669 type: FLUSH version: 2 ttl: 0 2023-11-22 10:55:20,167 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink 2023-11-22 10:55:20,173 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-22 10:55:20,178 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112217a05ffc826a4beab7c71b9983d702a3 2023-11-22 10:55:20,180 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122f7c429d72a9c4b6ca7caeae0504e640c 2023-11-22 10:55:20,181 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122083180bc27ae4a71bae9f381790f1575 2023-11-22 10:55:20,181 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,186 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,190 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,194 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,197 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,201 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,204 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,207 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,210 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,214 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,221 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,224 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 of snapshot=snaptb-1700650507659 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-22 10:55:20,230 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112205108387e26c4d97a9e90b3534d908cc_del 2023-11-22 10:55:20,231 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112262069b30723d4418b55439b152728999_del 2023-11-22 10:55:20,232 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112289c9a2aa323042d8be956af421b40915_del 2023-11-22 10:55:20,232 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,233 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,233 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,237 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/17dcb55fc9c545e3853f4dadab0be12c_SeqId_29_ 2023-11-22 10:55:20,237 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/2f6aa6f5af96472bafafe383894b2ba8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/2f6aa6f5af96472bafafe383894b2ba8 2023-11-22 10:55:20,237 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/a3c8e59e41f74fc49aac9a40bdc2c219_SeqId_29_ 2023-11-22 10:55:20,238 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dca3beca4aa14e329f7c51b906cb23d6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dca3beca4aa14e329f7c51b906cb23d6 2023-11-22 10:55:20,238 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 05ebbe878c0241ada0c13c53262cb1c5 of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,239 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/d24a422ddc7c43b89b1acf63de24f41a_SeqId_29_ 2023-11-22 10:55:20,239 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cf9058f8fd034eb4a9b1ff990877ac60 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cf9058f8fd034eb4a9b1ff990877ac60 2023-11-22 10:55:20,239 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 28ad22cdbc1c44feb9654f9e20c5f0ad of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,239 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de03e50b1add44fd8b75c0c9d06b7580 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,247 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9db15ef5cfcf4cb99d05e377bca8076c of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,251 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fb6e7ceef26542178952e8d364a9e03d of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,252 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 273cbafec14e4652a2524dfdc613e78c of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,254 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d8c28083098c413ea4c55d65e4321337 of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,256 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 81eef19593784a2daeade72315ad8859 of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,256 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f0c06e8857ea4b34a08d88e5dc1fd2d6 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,260 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a1f19273a26a4d1b83984301300e572d of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,262 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 15691cefc2344af2adf77f2df2dad088 of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,264 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 16c60db80bd943838f4b92e252fd566b of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,269 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6bba7aa65c1f4865807b5b4734b7715f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/6bba7aa65c1f4865807b5b4734b7715f 2023-11-22 10:55:20,269 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e67758c406524c1095b11e96be61fb02 of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,269 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/66662f82228c4693b52ab1e9ed478211 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/66662f82228c4693b52ab1e9ed478211 2023-11-22 10:55:20,269 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b651422114e94feda57aff4411f707b1 of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,272 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/8067a3d341074a279033477c642a4a5b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/8067a3d341074a279033477c642a4a5b 2023-11-22 10:55:20,272 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08fb9ad3c5a74448bcda2d75cc1aa464 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,286 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 98b6006d1fe04014a3958520072dc4a4 of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,286 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6eedb2d0780148b289c74d0c131b070e of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,286 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf8dabfb8e874e7cb0f4f5040d437790 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,295 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 860b38449f53404da8f7278c5c01a7f8 of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,295 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 801302aeb77d48f2ab1b47b0f76794cb of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,296 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 22861dc50edc45cc98491be841de1b19 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,299 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1bb25d570aaf4de78e3ff551a076a53c of snapshot=snaptb-1700650507659 to region=d76ac5550387fe39ca7acfefe93c1f17 table=testCompactionWithHFileLink 2023-11-22 10:55:20,300 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ea4c7b69820c4970b6c13cc1d14c6d22 of snapshot=snaptb-1700650507659 to region=89e8dba924da56cd9cec1acc7b8d626b table=testCompactionWithHFileLink 2023-11-22 10:55:20,300 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3bb74829358248dabab98ad4f30a3e22 of snapshot=snaptb-1700650507659 to region=c46ba14b3f8784c8b72ead76fe7a78cb table=testCompactionWithHFileLink 2023-11-22 10:55:20,304 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700650507659" table: "testCompactionWithHFileLink" creation_time: 1700650507669 type: FLUSH version: 2 ttl: 0 2023-11-22 10:55:20,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700650520305"}]},"ts":"9223372036854775807"} 2023-11-22 10:55:20,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700650520305"}]},"ts":"9223372036854775807"} 2023-11-22 10:55:20,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700650520305"}]},"ts":"9223372036854775807"} 2023-11-22 10:55:20,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-22 10:55:20,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 89e8dba924da56cd9cec1acc7b8d626b, NAME => 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c46ba14b3f8784c8b72ead76fe7a78cb, NAME => 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => d76ac5550387fe39ca7acfefe93c1f17, NAME => 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.', STARTKEY => '', ENDKEY => '1'}] 2023-11-22 10:55:20,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650520306"}]},"ts":"1700650520306"} 2023-11-22 10:55:20,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650520306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650520306"}]},"ts":"1700650520306"} 2023-11-22 10:55:20,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650520306"}]},"ts":"1700650520306"} 2023-11-22 10:55:20,309 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-22 10:55:20,309 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-22 10:55:20,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 89e8dba924da56cd9cec1acc7b8d626b, NAME => 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c46ba14b3f8784c8b72ead76fe7a78cb, NAME => 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => d76ac5550387fe39ca7acfefe93c1f17, NAME => 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.', STARTKEY => '', ENDKEY => '1'}] 2023-11-22 10:55:20,310 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700650507659 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-22 10:55:20,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700650507659" table: "testCompactionWithHFileLink" creation_time: 1700650507669 type: FLUSH version: 2 ttl: 0 ) in 570 msec 2023-11-22 10:55:20,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-22 10:55:20,356 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-22 10:55:20,356 INFO [Listener at localhost/45227] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:20,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700650507659-1700650517577" 2023-11-22 10:55:20,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700650507659-1700650517577 2023-11-22 10:55:20,367 INFO [Listener at localhost/45227] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-22 10:55:20,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-22 10:55:20,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-22 10:55:20,381 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-22 10:55:20,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-22 10:55:20,381 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650520381"}]},"ts":"1700650520381"} 2023-11-22 10:55:20,382 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-22 10:55:20,384 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-22 10:55:20,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN}] 2023-11-22 10:55:20,386 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN 2023-11-22 10:55:20,386 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN 2023-11-22 10:55:20,386 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN 2023-11-22 10:55:20,387 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-22 10:55:20,387 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-22 10:55:20,387 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-22 10:55:20,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-22 10:55:20,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,538 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650520538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650520538"}]},"ts":"1700650520538"} 2023-11-22 10:55:20,539 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650520538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650520538"}]},"ts":"1700650520538"} 2023-11-22 10:55:20,539 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650520538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650520538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650520538"}]},"ts":"1700650520538"} 2023-11-22 10:55:20,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:20,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:20,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:20,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-22 10:55:20,692 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:20,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d76ac5550387fe39ca7acfefe93c1f17, NAME => 'testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.', STARTKEY => '', ENDKEY => '1'} 2023-11-22 10:55:20,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:20,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,697 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,698 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:20,698 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:20,698 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d76ac5550387fe39ca7acfefe93c1f17 columnFamilyName family1 2023-11-22 10:55:20,708 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088 2023-11-22 10:55:20,713 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad 2023-11-22 10:55:20,718 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859 2023-11-22 10:55:20,723 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d 2023-11-22 10:55:20,723 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(310): Store=d76ac5550387fe39ca7acfefe93c1f17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,723 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,724 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2 2023-11-22 10:55:20,724 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2 2023-11-22 10:55:20,724 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d76ac5550387fe39ca7acfefe93c1f17 columnFamilyName family2 2023-11-22 10:55:20,731 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c 2023-11-22 10:55:20,736 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8 2023-11-22 10:55:20,741 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4 2023-11-22 10:55:20,747 DEBUG [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1 2023-11-22 10:55:20,747 INFO [StoreOpener-d76ac5550387fe39ca7acfefe93c1f17-1] regionserver.HStore(310): Store=d76ac5550387fe39ca7acfefe93c1f17/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:20,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:55:20,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d76ac5550387fe39ca7acfefe93c1f17; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69548611, jitterRate=0.03635506331920624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:20,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:20,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., pid=101, masterSystemTime=1700650520692 2023-11-22 10:55:20,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:20,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-22 10:55:20,754 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-22 10:55:20,754 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-22 10:55:20,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:20,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:20,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:20,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 89e8dba924da56cd9cec1acc7b8d626b, NAME => 'testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.', STARTKEY => '2', ENDKEY => ''} 2023-11-22 10:55:20,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d76ac5550387fe39ca7acfefe93c1f17, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:20,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650520756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650520756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650520756"}]},"ts":"1700650520756"} 2023-11-22 10:55:20,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,758 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=101, resume processing ppid=98 2023-11-22 10:55:20,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure d76ac5550387fe39ca7acfefe93c1f17, server=jenkins-hbase4.apache.org,46051,1700650400831 in 217 msec 2023-11-22 10:55:20,760 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-22 10:55:20,760 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1912): d76ac5550387fe39ca7acfefe93c1f17/family2 is initiating minor compaction (all files) 2023-11-22 10:55:20,760 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d76ac5550387fe39ca7acfefe93c1f17/family2 in testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:20,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d76ac5550387fe39ca7acfefe93c1f17, ASSIGN in 374 msec 2023-11-22 10:55:20,761 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp, totalSize=20.4 K 2023-11-22 10:55:20,761 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:20,761 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:20,761 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-22 10:55:20,761 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1912): d76ac5550387fe39ca7acfefe93c1f17/family1 is initiating minor compaction (all files) 2023-11-22 10:55:20,761 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89e8dba924da56cd9cec1acc7b8d626b columnFamilyName family1 2023-11-22 10:55:20,761 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d76ac5550387fe39ca7acfefe93c1f17/family1 in testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:55:20,762 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp, totalSize=21.6 K 2023-11-22 10:55:20,762 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501264 2023-11-22 10:55:20,763 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503057 2023-11-22 10:55:20,763 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501264 2023-11-22 10:55:20,764 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:20,764 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503057 2023-11-22 10:55:20,765 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:20,765 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:20,767 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:20,779 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b 2023-11-22 10:55:20,793 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c 2023-11-22 10:55:20,815 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580 2023-11-22 10:55:20,824 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] throttle.PressureAwareThroughputController(145): d76ac5550387fe39ca7acfefe93c1f17#family2#compaction#114 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:20,825 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): d76ac5550387fe39ca7acfefe93c1f17#family1#compaction#115 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:20,833 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6 2023-11-22 10:55:20,836 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(310): Store=89e8dba924da56cd9cec1acc7b8d626b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,837 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,839 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2 2023-11-22 10:55:20,839 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2 2023-11-22 10:55:20,840 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89e8dba924da56cd9cec1acc7b8d626b columnFamilyName family2 2023-11-22 10:55:20,847 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464 2023-11-22 10:55:20,856 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19 2023-11-22 10:55:20,866 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790 2023-11-22 10:55:20,872 DEBUG [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22 2023-11-22 10:55:20,873 INFO [StoreOpener-89e8dba924da56cd9cec1acc7b8d626b-1] regionserver.HStore(310): Store=89e8dba924da56cd9cec1acc7b8d626b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:20,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:55:20,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 89e8dba924da56cd9cec1acc7b8d626b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67855452, jitterRate=0.011125028133392334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:20,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:20,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., pid=102, masterSystemTime=1700650520692 2023-11-22 10:55:20,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-22 10:55:20,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-22 10:55:20,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:20,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:20,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:20,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c46ba14b3f8784c8b72ead76fe7a78cb, NAME => 'testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.', STARTKEY => '1', ENDKEY => '2'} 2023-11-22 10:55:20,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=89e8dba924da56cd9cec1acc7b8d626b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700650520887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650520887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650520887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650520887"}]},"ts":"1700650520887"} 2023-11-22 10:55:20,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:20,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,889 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,890 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:20,890 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:20,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=102, resume processing ppid=100 2023-11-22 10:55:20,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 89e8dba924da56cd9cec1acc7b8d626b, server=jenkins-hbase4.apache.org,46051,1700650400831 in 348 msec 2023-11-22 10:55:20,891 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46ba14b3f8784c8b72ead76fe7a78cb columnFamilyName family1 2023-11-22 10:55:20,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89e8dba924da56cd9cec1acc7b8d626b, ASSIGN in 506 msec 2023-11-22 10:55:20,899 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5 2023-11-22 10:55:20,904 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c 2023-11-22 10:55:20,909 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d 2023-11-22 10:55:20,914 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337 2023-11-22 10:55:20,915 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(310): Store=c46ba14b3f8784c8b72ead76fe7a78cb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,915 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,916 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2 2023-11-22 10:55:20,916 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2 2023-11-22 10:55:20,916 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46ba14b3f8784c8b72ead76fe7a78cb columnFamilyName family2 2023-11-22 10:55:20,922 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22 2023-11-22 10:55:20,931 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e 2023-11-22 10:55:20,935 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb 2023-11-22 10:55:20,940 DEBUG [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(539): loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02 2023-11-22 10:55:20,940 INFO [StoreOpener-c46ba14b3f8784c8b72ead76fe7a78cb-1] regionserver.HStore(310): Store=c46ba14b3f8784c8b72ead76fe7a78cb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:20,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:20,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:55:20,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c46ba14b3f8784c8b72ead76fe7a78cb; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66844442, jitterRate=-0.003940194845199585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:20,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:20,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., pid=103, masterSystemTime=1700650520692 2023-11-22 10:55:20,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-22 10:55:20,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-22 10:55:20,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:20,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:20,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c46ba14b3f8784c8b72ead76fe7a78cb, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:20,949 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650520948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650520948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650520948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650520948"}]},"ts":"1700650520948"} 2023-11-22 10:55:20,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=103, resume processing ppid=99 2023-11-22 10:55:20,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure c46ba14b3f8784c8b72ead76fe7a78cb, server=jenkins-hbase4.apache.org,46051,1700650400831 in 408 msec 2023-11-22 10:55:20,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=99, resume processing ppid=97 2023-11-22 10:55:20,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c46ba14b3f8784c8b72ead76fe7a78cb, ASSIGN in 566 msec 2023-11-22 10:55:20,953 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650520953"}]},"ts":"1700650520953"} 2023-11-22 10:55:20,954 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-22 10:55:20,956 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-22 10:55:20,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 583 msec 2023-11-22 10:55:20,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-22 10:55:20,984 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-22 10:55:20,998 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:21,005 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:21,014 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:21,015 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:21,022 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:55:21,037 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-22 10:55:21,037 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,038 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(139): Connect 0x33a81f8c to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:21,043 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b9fdaea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:21,044 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:21,044 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:21,044 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:21,653 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family1/fda09755bad7442facd50c4485ee36aa as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/fda09755bad7442facd50c4485ee36aa 2023-11-22 10:55:21,657 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d76ac5550387fe39ca7acfefe93c1f17/family1 of d76ac5550387fe39ca7acfefe93c1f17 into fda09755bad7442facd50c4485ee36aa(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:21,657 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:21,657 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., storeName=d76ac5550387fe39ca7acfefe93c1f17/family1, priority=12, startTime=1700650520753; duration=0sec 2023-11-22 10:55:21,657 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-22 10:55:21,658 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-22 10:55:21,660 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-22 10:55:21,660 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1912): 89e8dba924da56cd9cec1acc7b8d626b/family1 is initiating minor compaction (all files) 2023-11-22 10:55:21,660 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 89e8dba924da56cd9cec1acc7b8d626b/family1 in testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:21,660 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp, totalSize=21.6 K 2023-11-22 10:55:21,660 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501266 2023-11-22 10:55:21,661 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:21,661 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504478 2023-11-22 10:55:21,662 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:21,673 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 89e8dba924da56cd9cec1acc7b8d626b#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:21,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088] to archive 2023-11-22 10:55:21,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:21,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-28ad22cdbc1c44feb9654f9e20c5f0ad 2023-11-22 10:55:21,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-fb6e7ceef26542178952e8d364a9e03d 2023-11-22 10:55:21,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-81eef19593784a2daeade72315ad8859 2023-11-22 10:55:21,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-15691cefc2344af2adf77f2df2dad088 2023-11-22 10:55:21,903 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122ca09bacaf08e4b23bbad6330082664a3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231122ca09bacaf08e4b23bbad6330082664a3 2023-11-22 10:55:21,903 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122282d3cff4bb14ae88ef7f4cc46fc3845 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231122282d3cff4bb14ae88ef7f4cc46fc3845 2023-11-22 10:55:21,904 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,904 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,908 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122baf766c822e84c119bf7dd084a454440 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231122baf766c822e84c119bf7dd084a454440 2023-11-22 10:55:21,910 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,917 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:21,921 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:21,929 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:55:21,939 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:55:21,956 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/08e5b1e794524d5c902e9d74a18355a8 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-22 10:55:21,959 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/08e5b1e794524d5c902e9d74a18355a8}] 2023-11-22 10:55:21,967 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/748c78436a6d48e69a616615f01e2449 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-22 10:55:21,968 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/748c78436a6d48e69a616615f01e2449}] 2023-11-22 10:55:21,968 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/08e5b1e794524d5c902e9d74a18355a8 for inclusion in c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:21,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/748c78436a6d48e69a616615f01e2449 for inclusion in 89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:21,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-22 10:55:21,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-22 10:55:21,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:21,974 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/a1806a8405d249309d1492abdb7f991b first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-22 10:55:21,975 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/a1806a8405d249309d1492abdb7f991b}] 2023-11-22 10:55:21,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122/family1/08e5b1e794524d5c902e9d74a18355a8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__bhj5oqqf0ppspccgm9bt3lv62opn6nbh987fb23dikgo63mtm7s7acgu54tl7fi0/family1/08e5b1e794524d5c902e9d74a18355a8 2023-11-22 10:55:21,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-22 10:55:21,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-22 10:55:21,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:21,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/a1806a8405d249309d1492abdb7f991b for inclusion in d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:21,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122/family1/748c78436a6d48e69a616615f01e2449 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__buts0but5kcm55rnolodmgak5oqb8l334h44qo6vqsalnru1qf45cc6qu7vuvu5q/family1/748c78436a6d48e69a616615f01e2449 2023-11-22 10:55:21,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__bhj5oqqf0ppspccgm9bt3lv62opn6nbh987fb23dikgo63mtm7s7acgu54tl7fi0/family1/08e5b1e794524d5c902e9d74a18355a8 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_ 2023-11-22 10:55:21,979 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__bhj5oqqf0ppspccgm9bt3lv62opn6nbh987fb23dikgo63mtm7s7acgu54tl7fi0/family1/08e5b1e794524d5c902e9d74a18355a8 into c46ba14b3f8784c8b72ead76fe7a78cb/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_ - updating store file list. 2023-11-22 10:55:21,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-22 10:55:21,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-22 10:55:21,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:21,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__buts0but5kcm55rnolodmgak5oqb8l334h44qo6vqsalnru1qf45cc6qu7vuvu5q/family1/748c78436a6d48e69a616615f01e2449 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cacd1a4e9b7d4135b1aee1b4febab5d8_SeqId_34_ 2023-11-22 10:55:21,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122/family1/a1806a8405d249309d1492abdb7f991b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__e3kquld91eb6qmekld8asar6nt59vol08msmghnscnemgaldceqt89lckvoej9v9/family1/a1806a8405d249309d1492abdb7f991b 2023-11-22 10:55:21,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__buts0but5kcm55rnolodmgak5oqb8l334h44qo6vqsalnru1qf45cc6qu7vuvu5q/family1/748c78436a6d48e69a616615f01e2449 into 89e8dba924da56cd9cec1acc7b8d626b/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cacd1a4e9b7d4135b1aee1b4febab5d8_SeqId_34_ - updating store file list. 2023-11-22 10:55:21,984 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_ into c46ba14b3f8784c8b72ead76fe7a78cb/family1 2023-11-22 10:55:21,984 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__bhj5oqqf0ppspccgm9bt3lv62opn6nbh987fb23dikgo63mtm7s7acgu54tl7fi0/family1/08e5b1e794524d5c902e9d74a18355a8 into c46ba14b3f8784c8b72ead76fe7a78cb/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_) 2023-11-22 10:55:21,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__e3kquld91eb6qmekld8asar6nt59vol08msmghnscnemgaldceqt89lckvoej9v9/family1/a1806a8405d249309d1492abdb7f991b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/07ddd7f7f36e486ba96f58671dc9bbb2_SeqId_35_ 2023-11-22 10:55:21,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cacd1a4e9b7d4135b1aee1b4febab5d8_SeqId_34_ into 89e8dba924da56cd9cec1acc7b8d626b/family1 2023-11-22 10:55:21,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__buts0but5kcm55rnolodmgak5oqb8l334h44qo6vqsalnru1qf45cc6qu7vuvu5q/family1/748c78436a6d48e69a616615f01e2449 into 89e8dba924da56cd9cec1acc7b8d626b/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/cacd1a4e9b7d4135b1aee1b4febab5d8_SeqId_34_) 2023-11-22 10:55:21,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__e3kquld91eb6qmekld8asar6nt59vol08msmghnscnemgaldceqt89lckvoej9v9/family1/a1806a8405d249309d1492abdb7f991b into d76ac5550387fe39ca7acfefe93c1f17/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/07ddd7f7f36e486ba96f58671dc9bbb2_SeqId_35_ - updating store file list. 2023-11-22 10:55:21,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__bhj5oqqf0ppspccgm9bt3lv62opn6nbh987fb23dikgo63mtm7s7acgu54tl7fi0/family1/08e5b1e794524d5c902e9d74a18355a8 2023-11-22 10:55:21,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__buts0but5kcm55rnolodmgak5oqb8l334h44qo6vqsalnru1qf45cc6qu7vuvu5q/family1/748c78436a6d48e69a616615f01e2449 2023-11-22 10:55:21,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:21,987 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,988 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:21,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-22 10:55:21,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/07ddd7f7f36e486ba96f58671dc9bbb2_SeqId_35_ into d76ac5550387fe39ca7acfefe93c1f17/family1 2023-11-22 10:55:21,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(1912): c46ba14b3f8784c8b72ead76fe7a78cb/family1 is initiating minor compaction (all files) 2023-11-22 10:55:21,989 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311224e8e29744d0a40ff87e519ce8176028e 2023-11-22 10:55:21,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6a017a24; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-22 10:55:21,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__e3kquld91eb6qmekld8asar6nt59vol08msmghnscnemgaldceqt89lckvoej9v9/family1/a1806a8405d249309d1492abdb7f991b into d76ac5550387fe39ca7acfefe93c1f17/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family1/07ddd7f7f36e486ba96f58671dc9bbb2_SeqId_35_) 2023-11-22 10:55:21,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testCompactionWithHFileLink__e3kquld91eb6qmekld8asar6nt59vol08msmghnscnemgaldceqt89lckvoej9v9/family1/a1806a8405d249309d1492abdb7f991b 2023-11-22 10:55:21,991 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311227519ba1dbe1b4aabb92b551b639d1a08 2023-11-22 10:55:21,991 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,992 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:21,993 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:21,993 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:21,994 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231122852a31668b164b5f96be0f76bdada93f 2023-11-22 10:55:21,995 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311221cf1d8f381444689a5385b4745ff04d5 2023-11-22 10:55:21,995 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231122912b0e798fc447de897e3f4fc7bbb46d 2023-11-22 10:55:21,996 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:21,996 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231122' 2023-11-22 10:55:21,996 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112229c3ab252eaf4b019e92b3e50c5d2d1a 2023-11-22 10:55:21,996 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:21,996 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231122929fac7632844a3c8b9cb6f04e823eb5 2023-11-22 10:55:21,997 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122965b3cce23494cb1ae013803c2e3b6f5 2023-11-22 10:55:21,997 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311229cce51ba817d4e2f80568789a0be3df4 2023-11-22 10:55:21,998 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122a987f504237f4e77b0b624a1a88c201a 2023-11-22 10:55:21,999 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231122d6756652f0cf4665b8b00d305d9c0170 2023-11-22 10:55:21,999 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:21,999 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231122' 2023-11-22 10:55:21,999 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:22,000 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231122f700e8fa3562432fb04e0c2aec0f3325 2023-11-22 10:55:22,000 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-22 10:55:22,000 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231122' 2023-11-22 10:55:22,000 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231122 for table='testCompactionWithHFileLink' and column='family1' 2023-11-22 10:55:22,000 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-22 10:55:22,004 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:22,007 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:22,011 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:22,011 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:22,018 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:22,019 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:22,036 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=291 (was 239) - Thread LEAK? -, OpenFileDescriptor=795 (was 619) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 149) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9818 (was 9467) - AvailableMemoryMB LEAK? - 2023-11-22 10:55:22,047 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=291, OpenFileDescriptor=795, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=171, AvailableMemoryMB=9818 2023-11-22 10:55:22,053 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/.tmp/family2/42317816a2f14bc0b85f4550925e75b2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/42317816a2f14bc0b85f4550925e75b2 2023-11-22 10:55:22,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-22 10:55:22,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-22 10:55:22,058 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d76ac5550387fe39ca7acfefe93c1f17/family2 of d76ac5550387fe39ca7acfefe93c1f17 into 42317816a2f14bc0b85f4550925e75b2(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:22,059 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:55:22,059 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17., storeName=d76ac5550387fe39ca7acfefe93c1f17/family2, priority=12, startTime=1700650520754; duration=1sec 2023-11-22 10:55:22,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-22 10:55:22,059 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-22 10:55:22,059 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c46ba14b3f8784c8b72ead76fe7a78cb/family1 in testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:22,059 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp, totalSize=28.9 K 2023-11-22 10:55:22,060 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501265 2023-11-22 10:55:22,060 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-22 10:55:22,060 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:22,061 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:22,062 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:22,062 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting dff9b136e5144ead825e79e7f79c59ea_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700650501265 2023-11-22 10:55:22,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-22 10:55:22,075 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] throttle.PressureAwareThroughputController(145): c46ba14b3f8784c8b72ead76fe7a78cb#family1#compaction#117 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:22,088 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family1/e1fd454b8ba341fab2e3831d0040e101 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/e1fd454b8ba341fab2e3831d0040e101 2023-11-22 10:55:22,091 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 89e8dba924da56cd9cec1acc7b8d626b/family1 of 89e8dba924da56cd9cec1acc7b8d626b into e1fd454b8ba341fab2e3831d0040e101(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:22,091 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:22,091 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., storeName=89e8dba924da56cd9cec1acc7b8d626b/family1, priority=12, startTime=1700650520880; duration=0sec 2023-11-22 10:55:22,091 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-22 10:55:22,092 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-22 10:55:22,093 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-22 10:55:22,093 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1912): 89e8dba924da56cd9cec1acc7b8d626b/family2 is initiating minor compaction (all files) 2023-11-22 10:55:22,093 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 89e8dba924da56cd9cec1acc7b8d626b/family2 in testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:55:22,093 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp, totalSize=20.4 K 2023-11-22 10:55:22,094 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501266 2023-11-22 10:55:22,094 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:22,095 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504478 2023-11-22 10:55:22,095 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:22,106 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): 89e8dba924da56cd9cec1acc7b8d626b#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:22,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b] to archive 2023-11-22 10:55:22,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:22,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-de03e50b1add44fd8b75c0c9d06b7580 2023-11-22 10:55:22,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-273cbafec14e4652a2524dfdc613e78c 2023-11-22 10:55:22,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-f0c06e8857ea4b34a08d88e5dc1fd2d6 2023-11-22 10:55:22,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family1/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-16c60db80bd943838f4b92e252fd566b 2023-11-22 10:55:22,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c] to archive 2023-11-22 10:55:22,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:22,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-b651422114e94feda57aff4411f707b1 2023-11-22 10:55:22,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-98b6006d1fe04014a3958520072dc4a4 2023-11-22 10:55:22,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-860b38449f53404da8f7278c5c01a7f8 2023-11-22 10:55:22,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/family2/testCompactionWithHFileLink=d76ac5550387fe39ca7acfefe93c1f17-1bb25d570aaf4de78e3ff551a076a53c 2023-11-22 10:55:22,145 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-22 10:55:22,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-22 10:55:22,161 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-22 10:55:22,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-22 10:55:22,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:55:22,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-22 10:55:22,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:55:22,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:22,165 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:22,165 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:22,165 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88 empty. 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344 empty. 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e empty. 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344 2023-11-22 10:55:22,166 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:22,166 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-22 10:55:22,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:22,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:22,573 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-22 10:55:22,574 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => ab077d8a9706607380c45654591c8344, NAME => 'ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:22,575 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3d37bf20b62569aeda6c03678e88a02e, NAME => 'ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:22,575 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => aef988a75cfb01b10fb4b3de9e893b88, NAME => 'ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:22,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:22,891 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family1/3f743c74310e481481de807d926416fd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/3f743c74310e481481de807d926416fd 2023-11-22 10:55:22,896 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c46ba14b3f8784c8b72ead76fe7a78cb/family1 of c46ba14b3f8784c8b72ead76fe7a78cb into 3f743c74310e481481de807d926416fd(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:22,896 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:22,896 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700650521989; duration=0sec 2023-11-22 10:55:22,896 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-22 10:55:22,896 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-22 10:55:22,898 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-22 10:55:22,898 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1912): c46ba14b3f8784c8b72ead76fe7a78cb/family2 is initiating minor compaction (all files) 2023-11-22 10:55:22,898 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c46ba14b3f8784c8b72ead76fe7a78cb/family2 in testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:55:22,898 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp, totalSize=20.4 K 2023-11-22 10:55:22,899 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650501265 2023-11-22 10:55:22,899 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650503058 2023-11-22 10:55:22,900 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650504477 2023-11-22 10:55:22,900 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650505872 2023-11-22 10:55:22,912 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] throttle.PressureAwareThroughputController(145): c46ba14b3f8784c8b72ead76fe7a78cb#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-22 10:55:22,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_] to archive 2023-11-22 10:55:22,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:22,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-05ebbe878c0241ada0c13c53262cb1c5 2023-11-22 10:55:22,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-9db15ef5cfcf4cb99d05e377bca8076c 2023-11-22 10:55:22,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-d8c28083098c413ea4c55d65e4321337 2023-11-22 10:55:22,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-a1f19273a26a4d1b83984301300e572d 2023-11-22 10:55:22,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family1/dff9b136e5144ead825e79e7f79c59ea_SeqId_34_ 2023-11-22 10:55:22,963 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing aef988a75cfb01b10fb4b3de9e893b88, disabling compactions & flushes 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 3d37bf20b62569aeda6c03678e88a02e, disabling compactions & flushes 2023-11-22 10:55:22,981 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing ab077d8a9706607380c45654591c8344, disabling compactions & flushes 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:22,981 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. after waiting 0 ms 2023-11-22 10:55:22,981 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:22,981 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:22,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. after waiting 0 ms 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. after waiting 0 ms 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:22,982 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:22,982 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:22,982 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:22,984 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:55:22,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650522985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650522985"}]},"ts":"1700650522985"} 2023-11-22 10:55:22,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700650522985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650522985"}]},"ts":"1700650522985"} 2023-11-22 10:55:22,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650522985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650522985"}]},"ts":"1700650522985"} 2023-11-22 10:55:22,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-22 10:55:22,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:55:22,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650522988"}]},"ts":"1700650522988"} 2023-11-22 10:55:22,989 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-22 10:55:22,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aef988a75cfb01b10fb4b3de9e893b88, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3d37bf20b62569aeda6c03678e88a02e, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab077d8a9706607380c45654591c8344, ASSIGN}] 2023-11-22 10:55:22,999 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab077d8a9706607380c45654591c8344, ASSIGN 2023-11-22 10:55:22,999 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aef988a75cfb01b10fb4b3de9e893b88, ASSIGN 2023-11-22 10:55:22,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3d37bf20b62569aeda6c03678e88a02e, ASSIGN 2023-11-22 10:55:22,999 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab077d8a9706607380c45654591c8344, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:23,000 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aef988a75cfb01b10fb4b3de9e893b88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:23,000 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3d37bf20b62569aeda6c03678e88a02e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:23,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3d37bf20b62569aeda6c03678e88a02e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ab077d8a9706607380c45654591c8344, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aef988a75cfb01b10fb4b3de9e893b88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700650523151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650523151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650523151"}]},"ts":"1700650523151"} 2023-11-22 10:55:23,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650523151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650523151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650523151"}]},"ts":"1700650523151"} 2023-11-22 10:55:23,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650523151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650523151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650523151"}]},"ts":"1700650523151"} 2023-11-22 10:55:23,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 3d37bf20b62569aeda6c03678e88a02e, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:23,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure aef988a75cfb01b10fb4b3de9e893b88, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:23,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure ab077d8a9706607380c45654591c8344, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:23,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:23,305 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aef988a75cfb01b10fb4b3de9e893b88, NAME => 'ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.', STARTKEY => '', ENDKEY => '1'} 2023-11-22 10:55:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,310 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,311 DEBUG [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1 2023-11-22 10:55:23,311 DEBUG [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1 2023-11-22 10:55:23,312 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aef988a75cfb01b10fb4b3de9e893b88 columnFamilyName family1 2023-11-22 10:55:23,313 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] regionserver.HStore(310): Store=aef988a75cfb01b10fb4b3de9e893b88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,313 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,315 DEBUG [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2 2023-11-22 10:55:23,315 DEBUG [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2 2023-11-22 10:55:23,315 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aef988a75cfb01b10fb4b3de9e893b88 columnFamilyName family2 2023-11-22 10:55:23,317 INFO [StoreOpener-aef988a75cfb01b10fb4b3de9e893b88-1] regionserver.HStore(310): Store=aef988a75cfb01b10fb4b3de9e893b88/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:23,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:55:23,324 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/.tmp/family2/91545efa88e2463e8482a4c3f5b57c4b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/91545efa88e2463e8482a4c3f5b57c4b 2023-11-22 10:55:23,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:23,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aef988a75cfb01b10fb4b3de9e893b88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74871132, jitterRate=0.11566680669784546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:23,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:23,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88., pid=110, masterSystemTime=1700650523305 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:23,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:23,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab077d8a9706607380c45654591c8344, NAME => 'ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.', STARTKEY => '2', ENDKEY => ''} 2023-11-22 10:55:23,330 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aef988a75cfb01b10fb4b3de9e893b88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,330 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650523330"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650523330"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650523330"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650523330"}]},"ts":"1700650523330"} 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,331 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 89e8dba924da56cd9cec1acc7b8d626b/family2 of 89e8dba924da56cd9cec1acc7b8d626b into 91545efa88e2463e8482a4c3f5b57c4b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:23,331 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:55:23,331 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b., storeName=89e8dba924da56cd9cec1acc7b8d626b/family2, priority=12, startTime=1700650520880; duration=1sec 2023-11-22 10:55:23,331 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-22 10:55:23,331 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-22 10:55:23,331 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,332 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-22 10:55:23,332 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-22 10:55:23,332 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. because compaction request was cancelled 2023-11-22 10:55:23,333 DEBUG [StoreOpener-ab077d8a9706607380c45654591c8344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1 2023-11-22 10:55:23,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=110, resume processing ppid=106 2023-11-22 10:55:23,333 DEBUG [StoreOpener-ab077d8a9706607380c45654591c8344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1 2023-11-22 10:55:23,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure aef988a75cfb01b10fb4b3de9e893b88, server=jenkins-hbase4.apache.org,46051,1700650400831 in 177 msec 2023-11-22 10:55:23,333 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab077d8a9706607380c45654591c8344 columnFamilyName family1 2023-11-22 10:55:23,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aef988a75cfb01b10fb4b3de9e893b88, ASSIGN in 336 msec 2023-11-22 10:55:23,334 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] regionserver.HStore(310): Store=ab077d8a9706607380c45654591c8344/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,335 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,335 DEBUG [StoreOpener-ab077d8a9706607380c45654591c8344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2 2023-11-22 10:55:23,335 DEBUG [StoreOpener-ab077d8a9706607380c45654591c8344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2 2023-11-22 10:55:23,336 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab077d8a9706607380c45654591c8344 columnFamilyName family2 2023-11-22 10:55:23,337 INFO [StoreOpener-ab077d8a9706607380c45654591c8344-1] regionserver.HStore(310): Store=ab077d8a9706607380c45654591c8344/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:23,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ab077d8a9706607380c45654591c8344 2023-11-22 10:55:23,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:23,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ab077d8a9706607380c45654591c8344; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61549179, jitterRate=-0.0828457623720169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:23,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:23,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344., pid=111, masterSystemTime=1700650523305 2023-11-22 10:55:23,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:23,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:23,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:23,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d37bf20b62569aeda6c03678e88a02e, NAME => 'ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.', STARTKEY => '1', ENDKEY => '2'} 2023-11-22 10:55:23,343 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ab077d8a9706607380c45654591c8344, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700650523343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650523343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650523343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650523343"}]},"ts":"1700650523343"} 2023-11-22 10:55:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,345 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,346 DEBUG [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1 2023-11-22 10:55:23,346 DEBUG [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1 2023-11-22 10:55:23,346 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d37bf20b62569aeda6c03678e88a02e columnFamilyName family1 2023-11-22 10:55:23,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=111, resume processing ppid=108 2023-11-22 10:55:23,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure ab077d8a9706607380c45654591c8344, server=jenkins-hbase4.apache.org,46051,1700650400831 in 191 msec 2023-11-22 10:55:23,347 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] regionserver.HStore(310): Store=3d37bf20b62569aeda6c03678e88a02e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab077d8a9706607380c45654591c8344, ASSIGN in 349 msec 2023-11-22 10:55:23,347 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,348 DEBUG [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2 2023-11-22 10:55:23,348 DEBUG [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2 2023-11-22 10:55:23,348 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d37bf20b62569aeda6c03678e88a02e columnFamilyName family2 2023-11-22 10:55:23,349 INFO [StoreOpener-3d37bf20b62569aeda6c03678e88a02e-1] regionserver.HStore(310): Store=3d37bf20b62569aeda6c03678e88a02e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:23,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:23,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:55:23,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3d37bf20b62569aeda6c03678e88a02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70584266, jitterRate=0.05178752541542053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e., pid=109, masterSystemTime=1700650523305 2023-11-22 10:55:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:23,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:23,356 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3d37bf20b62569aeda6c03678e88a02e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:23,356 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700650523356"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650523356"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650523356"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650523356"}]},"ts":"1700650523356"} 2023-11-22 10:55:23,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=109, resume processing ppid=107 2023-11-22 10:55:23,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 3d37bf20b62569aeda6c03678e88a02e, server=jenkins-hbase4.apache.org,46051,1700650400831 in 204 msec 2023-11-22 10:55:23,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=107, resume processing ppid=105 2023-11-22 10:55:23,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3d37bf20b62569aeda6c03678e88a02e, ASSIGN in 361 msec 2023-11-22 10:55:23,359 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:55:23,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650523360"}]},"ts":"1700650523360"} 2023-11-22 10:55:23,360 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-22 10:55:23,363 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:55:23,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2020 sec 2023-11-22 10:55:23,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22] to archive 2023-11-22 10:55:23,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:23,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-08fb9ad3c5a74448bcda2d75cc1aa464 2023-11-22 10:55:23,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-cf8dabfb8e874e7cb0f4f5040d437790 2023-11-22 10:55:23,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-22861dc50edc45cc98491be841de1b19 2023-11-22 10:55:23,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/family2/testCompactionWithHFileLink=89e8dba924da56cd9cec1acc7b8d626b-ea4c7b69820c4970b6c13cc1d14c6d22 2023-11-22 10:55:24,133 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/.tmp/family2/c1c684a391f34023941c948c5ca2bb73 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/c1c684a391f34023941c948c5ca2bb73 2023-11-22 10:55:24,138 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c46ba14b3f8784c8b72ead76fe7a78cb/family2 of c46ba14b3f8784c8b72ead76fe7a78cb into c1c684a391f34023941c948c5ca2bb73(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:24,138 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:55:24,138 INFO [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb., storeName=c46ba14b3f8784c8b72ead76fe7a78cb/family2, priority=12, startTime=1700650520946; duration=1sec 2023-11-22 10:55:24,138 DEBUG [RS:0;jenkins-hbase4:46051-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:24,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22] to archive 2023-11-22 10:55:24,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:24,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-e67758c406524c1095b11e96be61fb02 2023-11-22 10:55:24,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-6eedb2d0780148b289c74d0c131b070e 2023-11-22 10:55:24,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-801302aeb77d48f2ab1b47b0f76794cb 2023-11-22 10:55:24,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/family2/testCompactionWithHFileLink=c46ba14b3f8784c8b72ead76fe7a78cb-3bb74829358248dabab98ad4f30a3e22 2023-11-22 10:55:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-22 10:55:24,269 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-22 10:55:24,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:24,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:24,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:24,278 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:24,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-22 10:55:24,280 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-22 10:55:24,280 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:24,280 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-22 10:55:24,280 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-22 10:55:24,280 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:24,280 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:24,281 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:24,282 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:24,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:24,282 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:24,282 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:24,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:24,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-22 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-22 10:55:24,283 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-22 10:55:24,283 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:24,283 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-22 10:55:24,283 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:24,283 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. started... 2023-11-22 10:55:24,283 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:24,285 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:24,285 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ab077d8a9706607380c45654591c8344 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:24,285 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:24,285 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. started... 2023-11-22 10:55:24,285 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:24,285 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3d37bf20b62569aeda6c03678e88a02e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:24,285 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. started... 2023-11-22 10:55:24,285 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aef988a75cfb01b10fb4b3de9e893b88 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:24,299 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112253d3b4a6cc04454da0c96c8ef275ebc1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112253d3b4a6cc04454da0c96c8ef275ebc1 2023-11-22 10:55:24,700 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122d5a48ce4ff3b4422bcc32675ecb4dfff to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231122d5a48ce4ff3b4422bcc32675ecb4dfff 2023-11-22 10:55:24,701 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112230a8f693b8ea4dbfbade604bef6c32fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112230a8f693b8ea4dbfbade604bef6c32fc 2023-11-22 10:55:24,704 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/3093f09ca25643bb985c548b1df52fee 2023-11-22 10:55:25,106 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/fe04f6c32040412b8d08453340324db0 2023-11-22 10:55:25,106 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/5cf0c25d837949cdbcc7e3c418a6be78 2023-11-22 10:55:25,129 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:55:25,129 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33a81f8c to 127.0.0.1:57046 2023-11-22 10:55:25,129 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:25,129 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:55:25,129 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14921606 to 127.0.0.1:57046 2023-11-22 10:55:25,129 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:25,130 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:55:25,130 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09f10c60 to 127.0.0.1:57046 2023-11-22 10:55:25,130 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:25,130 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122b887dba5559a418ca68b2a617ebe073c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231122b887dba5559a418ca68b2a617ebe073c 2023-11-22 10:55:25,138 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/72f1188aae264110b48d366995018005 2023-11-22 10:55:25,138 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122973af0c86bca44edb90c0e22c550b54e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231122973af0c86bca44edb90c0e22c550b54e 2023-11-22 10:55:25,141 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/3093f09ca25643bb985c548b1df52fee as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee 2023-11-22 10:55:25,145 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:25,145 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/72f1188aae264110b48d366995018005 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005 2023-11-22 10:55:25,148 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:25,149 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3d37bf20b62569aeda6c03678e88a02e in 864ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:25,149 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-22 10:55:25,149 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:25,150 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:25,150 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:25,538 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311223d89c84c134748f99ee5e5c418f91f64 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311223d89c84c134748f99ee5e5c418f91f64 2023-11-22 10:55:25,543 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/6786d504d8884f119e35b3cd05ba086d 2023-11-22 10:55:25,547 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/fe04f6c32040412b8d08453340324db0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0 2023-11-22 10:55:25,551 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:25,551 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/6786d504d8884f119e35b3cd05ba086d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d 2023-11-22 10:55:25,554 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:25,555 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for aef988a75cfb01b10fb4b3de9e893b88 in 1270ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:25,556 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:25,556 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:25,556 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:25,945 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/959e52584e3c4f349c431aa9fe3bb23f 2023-11-22 10:55:25,949 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/5cf0c25d837949cdbcc7e3c418a6be78 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78 2023-11-22 10:55:25,952 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78, entries=4, sequenceid=5, filesize=5.4 K 2023-11-22 10:55:25,953 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/959e52584e3c4f349c431aa9fe3bb23f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f 2023-11-22 10:55:25,957 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:25,957 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ab077d8a9706607380c45654591c8344 in 1672ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:25,957 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:25,957 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-22 10:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-22 10:55:25,959 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-22 10:55:25,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@696da1d1[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:25,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-22 10:55:25,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,963 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,963 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-22 10:55:25,963 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-22 10:55:25,963 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,963 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:25,963 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-22 10:55:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:25,965 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-22 10:55:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-22 10:55:25,967 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-22 10:55:25,967 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:25,967 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:25,967 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-22 10:55:25,967 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:25,970 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,970 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:25,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,971 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:25,971 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,973 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:25,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:25,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-22 10:55:25,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:25,975 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:25,976 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,976 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:25,975 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:25,976 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:25,976 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:25,976 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:25,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:26,076 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:26,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:26,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:26,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:26,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:26,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:26,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:26,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-22 10:55:26,083 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-22 10:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-22 10:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-22 10:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:26,084 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:26,084 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:26,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:26,085 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:26,085 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:26,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:26,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-22 10:55:26,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-22 10:55:26,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-22 10:55:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-22 10:55:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. started... 2023-11-22 10:55:26,086 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. started... 2023-11-22 10:55:26,086 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. started... 2023-11-22 10:55:26,086 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ab077d8a9706607380c45654591c8344 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:26,086 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aef988a75cfb01b10fb4b3de9e893b88 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:26,086 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3d37bf20b62569aeda6c03678e88a02e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:26,506 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112267ef4bcee425449db3e732e36e04df9a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112267ef4bcee425449db3e732e36e04df9a 2023-11-22 10:55:26,508 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112243c521589cf74ebb8a7303a03b94bc66 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112243c521589cf74ebb8a7303a03b94bc66 2023-11-22 10:55:26,508 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311228c84313a357f4e85a35fdf6683d7009e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311228c84313a357f4e85a35fdf6683d7009e 2023-11-22 10:55:26,511 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/97d5bce4e64341a28575e20f11b7d443 2023-11-22 10:55:26,513 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/23702cbd9c4c4b3c83a21d60f814eb3f 2023-11-22 10:55:26,514 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/fc0666f57b804708a1144a40be915a5c 2023-11-22 10:55:26,525 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122f46330ba1b21479ea5e7570f538278e4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231122f46330ba1b21479ea5e7570f538278e4 2023-11-22 10:55:26,529 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122f027bd74f8c940248c1a1cab96ede106 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231122f027bd74f8c940248c1a1cab96ede106 2023-11-22 10:55:26,929 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112259bdf532baba4295b9f574213d416a00 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112259bdf532baba4295b9f574213d416a00 2023-11-22 10:55:26,945 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/3df2974287404a7daae442f93b173ece 2023-11-22 10:55:26,945 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/a82b834694e44d51ac2efd0a8dbc4b3a 2023-11-22 10:55:26,949 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/23702cbd9c4c4b3c83a21d60f814eb3f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f 2023-11-22 10:55:26,950 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/97d5bce4e64341a28575e20f11b7d443 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443 2023-11-22 10:55:26,954 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:26,955 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:26,955 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/a82b834694e44d51ac2efd0a8dbc4b3a as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a 2023-11-22 10:55:26,959 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:26,959 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for aef988a75cfb01b10fb4b3de9e893b88 in 873ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:26,959 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:26,959 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:26,959 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:26,968 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/3df2974287404a7daae442f93b173ece as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece 2023-11-22 10:55:26,971 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:26,972 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3d37bf20b62569aeda6c03678e88a02e in 886ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:26,972 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:26,972 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:26,972 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:27,334 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/650191bfebfc497294821939174de967 2023-11-22 10:55:27,338 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/fc0666f57b804708a1144a40be915a5c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c 2023-11-22 10:55:27,342 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-22 10:55:27,342 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/650191bfebfc497294821939174de967 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967 2023-11-22 10:55:27,346 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:27,347 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ab077d8a9706607380c45654591c8344 in 1261ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:27,347 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:27,347 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-22 10:55:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-22 10:55:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,349 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:27,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:27,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-22 10:55:27,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67fa408[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:27,351 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-22 10:55:27,351 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,356 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-22 10:55:27,357 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,357 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:27,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-22 10:55:27,357 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:27,359 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,359 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:27,359 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:27,359 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:27,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-22 10:55:27,361 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-22 10:55:27,361 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:27,361 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:27,361 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-22 10:55:27,361 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:27,363 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,363 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:27,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,363 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:27,363 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,365 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:27,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:27,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-22 10:55:27,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:27,367 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:27,367 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,368 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:27,368 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:27,368 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:27,368 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:27,468 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:27,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:27,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:27,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:27,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:27,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:27,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:27,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-22 10:55:27,474 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-22 10:55:27,474 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:27,474 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-22 10:55:27,474 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-22 10:55:27,474 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,474 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:27,477 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,477 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:27,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:27,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:27,477 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:27,477 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:27,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:27,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:27,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:27,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:27,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-22 10:55:27,478 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-22 10:55:27,478 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-22 10:55:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-22 10:55:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. started... 2023-11-22 10:55:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:27,479 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ab077d8a9706607380c45654591c8344 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. started... 2023-11-22 10:55:27,479 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. started... 2023-11-22 10:55:27,479 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3d37bf20b62569aeda6c03678e88a02e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:27,479 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aef988a75cfb01b10fb4b3de9e893b88 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:27,515 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122fcedb34216c64ff8b88954f74ad46e1a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231122fcedb34216c64ff8b88954f74ad46e1a 2023-11-22 10:55:27,519 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311221ffc42337f92489981b8cf09f91944cb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311221ffc42337f92489981b8cf09f91944cb 2023-11-22 10:55:27,526 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122281e374cc09f4d1ebcf0abc032e611bb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231122281e374cc09f4d1ebcf0abc032e611bb 2023-11-22 10:55:27,528 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/3e27dca8bb5e4242a262081dae2863c8 2023-11-22 10:55:27,548 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/7dad0a2838bc4e86a107d92c71584030 2023-11-22 10:55:27,554 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122fd0cb414e9df413e9f0313e4b1d0b039 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231122fd0cb414e9df413e9f0313e4b1d0b039 2023-11-22 10:55:27,562 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/45a53b9ab8174a67ae000ac417a26e4e 2023-11-22 10:55:27,564 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311227ee8fc9aa36f4ec7b473558a328911da to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311227ee8fc9aa36f4ec7b473558a328911da 2023-11-22 10:55:27,566 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/3e27dca8bb5e4242a262081dae2863c8 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8 2023-11-22 10:55:27,570 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:27,570 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/45a53b9ab8174a67ae000ac417a26e4e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e 2023-11-22 10:55:27,573 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:27,574 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for aef988a75cfb01b10fb4b3de9e893b88 in 95ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:27,574 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:27,574 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:27,942 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/001d72885d8b45518c1d08f6e4049052 2023-11-22 10:55:27,969 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/9fa8736b3cab4631a14081b2c84a830a 2023-11-22 10:55:27,973 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/7dad0a2838bc4e86a107d92c71584030 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030 2023-11-22 10:55:27,976 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:27,977 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/9fa8736b3cab4631a14081b2c84a830a as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a 2023-11-22 10:55:27,981 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:27,981 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3d37bf20b62569aeda6c03678e88a02e in 502ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:27,981 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:27,981 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:27,981 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:28,356 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122f1d18ae6b5204f49863305b9bf28fa35 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231122f1d18ae6b5204f49863305b9bf28fa35 2023-11-22 10:55:28,761 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/1503832fe2724d778d6701a8bd97d8a5 2023-11-22 10:55:28,765 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/001d72885d8b45518c1d08f6e4049052 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052 2023-11-22 10:55:28,768 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052, entries=4, sequenceid=13, filesize=5.4 K 2023-11-22 10:55:28,769 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/1503832fe2724d778d6701a8bd97d8a5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5 2023-11-22 10:55:28,772 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:28,773 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ab077d8a9706607380c45654591c8344 in 1294ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:28,773 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:28,773 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-22 10:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-22 10:55:28,775 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,775 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:28,775 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,775 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:28,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-22 10:55:28,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2985b392[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:28,777 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-22 10:55:28,777 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,778 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-22 10:55:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-22 10:55:28,778 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,778 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-22 10:55:28,780 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-22 10:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:28,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-22 10:55:28,782 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-22 10:55:28,782 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:28,783 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:28,783 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-22 10:55:28,783 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:28,790 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,790 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,790 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:28,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:28,790 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,792 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:28,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:28,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:28,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:28,795 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:28,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:28,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-22 10:55:28,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:28,795 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:28,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:28,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-22 10:55:28,796 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:28,810 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:55:28,896 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:28,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:28,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:28,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:28,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:28,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:28,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:28,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-22 10:55:28,903 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-22 10:55:28,903 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:28,903 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-22 10:55:28,903 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-22 10:55:28,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,904 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:28,905 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:28,905 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:28,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:28,906 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:28,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:28,906 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:28,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:28,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:28,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:28,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-22 10:55:28,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-22 10:55:28,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-22 10:55:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-22 10:55:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. started... 2023-11-22 10:55:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:28,907 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ab077d8a9706607380c45654591c8344 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. started... 2023-11-22 10:55:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:28,907 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. started... 2023-11-22 10:55:28,907 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3d37bf20b62569aeda6c03678e88a02e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:28,908 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aef988a75cfb01b10fb4b3de9e893b88 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:28,921 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122dc19a52c082c4682aa32f78bb7c7cfc1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231122dc19a52c082c4682aa32f78bb7c7cfc1 2023-11-22 10:55:29,321 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122e80eaf8b7411446fae76a9b8f8246607 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231122e80eaf8b7411446fae76a9b8f8246607 2023-11-22 10:55:29,322 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311220b3a0d03abf444edb20ea94a0c94c18c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311220b3a0d03abf444edb20ea94a0c94c18c 2023-11-22 10:55:29,326 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/75cf03640d2f42ccadd32bd336cccf07 2023-11-22 10:55:29,727 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/2cd18d92298644d09df2fd5838ebaeba 2023-11-22 10:55:29,727 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/5ea31e1a1bc7494bbdac87c5577a6ad2 2023-11-22 10:55:29,739 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311220f117d8ad2a04c78be4d26abfd4d7a21 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311220f117d8ad2a04c78be4d26abfd4d7a21 2023-11-22 10:55:29,740 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122fd8bb61d4abb47849e552e0823494759 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231122fd8bb61d4abb47849e552e0823494759 2023-11-22 10:55:29,744 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/becc148503f54f3790672176c5854ee5 2023-11-22 10:55:29,747 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/5ea31e1a1bc7494bbdac87c5577a6ad2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2 2023-11-22 10:55:29,750 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:29,751 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/becc148503f54f3790672176c5854ee5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5 2023-11-22 10:55:29,753 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:29,754 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for aef988a75cfb01b10fb4b3de9e893b88 in 846ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:29,754 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:29,754 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:30,141 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122b9e4d5cb8f4f4a2fb33e9266a7685367 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231122b9e4d5cb8f4f4a2fb33e9266a7685367 2023-11-22 10:55:30,145 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/17eb4de28ad54c9194bb17686cc656c9 2023-11-22 10:55:30,148 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/75cf03640d2f42ccadd32bd336cccf07 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07 2023-11-22 10:55:30,151 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:30,152 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/17eb4de28ad54c9194bb17686cc656c9 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9 2023-11-22 10:55:30,156 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:30,156 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ab077d8a9706607380c45654591c8344 in 1249ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:30,156 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:30,156 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:30,545 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/8ecae873b48b45318015aa127f738ad2 2023-11-22 10:55:30,549 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/2cd18d92298644d09df2fd5838ebaeba as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba 2023-11-22 10:55:30,552 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba, entries=4, sequenceid=17, filesize=5.4 K 2023-11-22 10:55:30,553 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/8ecae873b48b45318015aa127f738ad2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2 2023-11-22 10:55:30,556 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:30,557 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3d37bf20b62569aeda6c03678e88a02e in 1650ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:30,557 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:30,557 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:30,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:30,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:30,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-22 10:55:30,557 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-22 10:55:30,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,559 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:30,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,559 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:30,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-22 10:55:30,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@767a84b9[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:30,562 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-22 10:55:30,562 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,564 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-22 10:55:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-22 10:55:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:30,564 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,564 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:30,566 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-22 10:55:30,566 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:30,566 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,566 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-22 10:55:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:30,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-22 10:55:30,569 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-22 10:55:30,569 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:30,569 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:30,569 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-22 10:55:30,569 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:30,571 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,571 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,571 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:30,571 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,573 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:30,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:30,575 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:30,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:30,575 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:30,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-22 10:55:30,575 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-22 10:55:30,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:30,576 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:30,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:30,676 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:30,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:30,689 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:30,699 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:30,708 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:30,708 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:30,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:30,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:30,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-22 10:55:30,735 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-22 10:55:30,735 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:30,735 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-22 10:55:30,735 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-22 10:55:30,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:30,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,738 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:30,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:30,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:30,738 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:30,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:30,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-22 10:55:30,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-22 10:55:30,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-22 10:55:30,739 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-22 10:55:30,739 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:30,739 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-22 10:55:30,739 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:30,740 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:30,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. started... 2023-11-22 10:55:30,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:30,740 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:30,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:30,740 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ab077d8a9706607380c45654591c8344 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:30,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. started... 2023-11-22 10:55:30,740 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. started... 2023-11-22 10:55:30,740 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3d37bf20b62569aeda6c03678e88a02e 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:30,740 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aef988a75cfb01b10fb4b3de9e893b88 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:31,162 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/f43f976cbac24dd48169306784c90775 2023-11-22 10:55:31,165 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f43f976cbac24dd48169306784c90775 2023-11-22 10:55:31,561 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/7fe0299adcc94c50bd93b822bc040cb9 2023-11-22 10:55:31,562 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/a14f94df18844fbb8fb966c3ce5dedeb 2023-11-22 10:55:31,565 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fe0299adcc94c50bd93b822bc040cb9 2023-11-22 10:55:31,566 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a14f94df18844fbb8fb966c3ce5dedeb 2023-11-22 10:55:31,576 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/a4b63fb45d4641539a199eeef7fa0933 2023-11-22 10:55:31,579 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4b63fb45d4641539a199eeef7fa0933 2023-11-22 10:55:31,580 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/f43f976cbac24dd48169306784c90775 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775 2023-11-22 10:55:31,583 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f43f976cbac24dd48169306784c90775 2023-11-22 10:55:31,583 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775, entries=3, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,583 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/a4b63fb45d4641539a199eeef7fa0933 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933 2023-11-22 10:55:31,586 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4b63fb45d4641539a199eeef7fa0933 2023-11-22 10:55:31,586 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,587 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for aef988a75cfb01b10fb4b3de9e893b88 in 847ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:31,587 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:31,587 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:31,587 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:31,977 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/a253f30334f24ba987c55a17a8cfa1aa 2023-11-22 10:55:31,978 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/936478d67f91473da568e749a29c6bf3 2023-11-22 10:55:31,981 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a253f30334f24ba987c55a17a8cfa1aa 2023-11-22 10:55:31,981 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 936478d67f91473da568e749a29c6bf3 2023-11-22 10:55:31,982 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/a14f94df18844fbb8fb966c3ce5dedeb as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb 2023-11-22 10:55:31,982 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/7fe0299adcc94c50bd93b822bc040cb9 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9 2023-11-22 10:55:31,985 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a14f94df18844fbb8fb966c3ce5dedeb 2023-11-22 10:55:31,986 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fe0299adcc94c50bd93b822bc040cb9 2023-11-22 10:55:31,986 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb, entries=3, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,986 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9, entries=3, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,986 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/936478d67f91473da568e749a29c6bf3 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3 2023-11-22 10:55:31,986 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/a253f30334f24ba987c55a17a8cfa1aa as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa 2023-11-22 10:55:31,990 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 936478d67f91473da568e749a29c6bf3 2023-11-22 10:55:31,990 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,990 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a253f30334f24ba987c55a17a8cfa1aa 2023-11-22 10:55:31,990 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:31,991 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3d37bf20b62569aeda6c03678e88a02e in 1251ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:31,991 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:31,991 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:31,991 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ab077d8a9706607380c45654591c8344 in 1251ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:31,991 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:31,991 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-22 10:55:31,991 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-22 10:55:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,993 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-22 10:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e7a0c7[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:31,995 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-22 10:55:31,995 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,996 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:31,996 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-22 10:55:31,996 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-22 10:55:31,996 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:31,996 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,996 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:31,997 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-22 10:55:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:31,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:31,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:31,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:31,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:32,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-22 10:55:32,000 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-22 10:55:32,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:32,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:32,000 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-22 10:55:32,000 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:32,003 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,003 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:32,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,003 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:32,003 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,004 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-22 10:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:32,007 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-22 10:55:32,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:32,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-22 10:55:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:32,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:32,007 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-22 10:55:32,008 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:32,008 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:32,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:32,108 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:32,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:32,109 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:32,109 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): ab077d8a9706607380c45654591c8344/family1 is initiating major compaction (all files) 2023-11-22 10:55:32,109 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:32,109 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:32,109 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of ab077d8a9706607380c45654591c8344/family1 in ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:32,110 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp, totalSize=26.6 K 2023-11-22 10:55:32,110 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 5cf0c25d837949cdbcc7e3c418a6be78, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524276 2023-11-22 10:55:32,111 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting fc0666f57b804708a1144a40be915a5c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526079 2023-11-22 10:55:32,111 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 001d72885d8b45518c1d08f6e4049052, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:32,111 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 75cf03640d2f42ccadd32bd336cccf07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528899 2023-11-22 10:55:32,112 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a14f94df18844fbb8fb966c3ce5dedeb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:32,121 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): ab077d8a9706607380c45654591c8344#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:32,529 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311222419dc6f8d4e4f55a07e97e7907875be_del 2023-11-22 10:55:32,529 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311222419dc6f8d4e4f55a07e97e7907875be_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311222419dc6f8d4e4f55a07e97e7907875be_del 2023-11-22 10:55:33,342 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9889b770ae2045b78fd7675a8efd3ba4 2023-11-22 10:55:33,343 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family1/9889b770ae2045b78fd7675a8efd3ba4 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/9889b770ae2045b78fd7675a8efd3ba4 2023-11-22 10:55:33,346 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9889b770ae2045b78fd7675a8efd3ba4 2023-11-22 10:55:33,347 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ab077d8a9706607380c45654591c8344/family1 of ab077d8a9706607380c45654591c8344 into 9889b770ae2045b78fd7675a8efd3ba4(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:33,347 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:33,347 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:33,347 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): ab077d8a9706607380c45654591c8344/family2 is initiating major compaction (all files) 2023-11-22 10:55:33,347 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:33,347 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:33,348 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of ab077d8a9706607380c45654591c8344/family2 in ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:55:33,348 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp, totalSize=25.3 K 2023-11-22 10:55:33,349 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 959e52584e3c4f349c431aa9fe3bb23f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524276 2023-11-22 10:55:33,349 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 650191bfebfc497294821939174de967, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526079 2023-11-22 10:55:33,349 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 1503832fe2724d778d6701a8bd97d8a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:33,350 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 17eb4de28ad54c9194bb17686cc656c9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528899 2023-11-22 10:55:33,350 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a253f30334f24ba987c55a17a8cfa1aa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:33,358 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): ab077d8a9706607380c45654591c8344#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:33,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb] to archive 2023-11-22 10:55:33,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:33,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/5cf0c25d837949cdbcc7e3c418a6be78 2023-11-22 10:55:33,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/fc0666f57b804708a1144a40be915a5c 2023-11-22 10:55:33,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/001d72885d8b45518c1d08f6e4049052 2023-11-22 10:55:33,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/75cf03640d2f42ccadd32bd336cccf07 2023-11-22 10:55:33,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/a14f94df18844fbb8fb966c3ce5dedeb 2023-11-22 10:55:33,766 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112288205df9cec146a39913ee48933d8898_del 2023-11-22 10:55:33,766 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112288205df9cec146a39913ee48933d8898_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112288205df9cec146a39913ee48933d8898_del 2023-11-22 10:55:34,579 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77e45e9371a64f0ca3744d340ae73131 2023-11-22 10:55:34,580 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/.tmp/family2/77e45e9371a64f0ca3744d340ae73131 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/77e45e9371a64f0ca3744d340ae73131 2023-11-22 10:55:34,583 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77e45e9371a64f0ca3744d340ae73131 2023-11-22 10:55:34,584 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ab077d8a9706607380c45654591c8344/family2 of ab077d8a9706607380c45654591c8344 into 77e45e9371a64f0ca3744d340ae73131(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:34,584 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:34,584 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:34,585 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): aef988a75cfb01b10fb4b3de9e893b88/family1 is initiating major compaction (all files) 2023-11-22 10:55:34,585 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:34,585 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:34,586 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of aef988a75cfb01b10fb4b3de9e893b88/family1 in ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:34,586 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp, totalSize=26.6 K 2023-11-22 10:55:34,586 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting fe04f6c32040412b8d08453340324db0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524275 2023-11-22 10:55:34,587 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 97d5bce4e64341a28575e20f11b7d443, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526078 2023-11-22 10:55:34,587 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 3e27dca8bb5e4242a262081dae2863c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:34,588 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 5ea31e1a1bc7494bbdac87c5577a6ad2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528898 2023-11-22 10:55:34,588 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting f43f976cbac24dd48169306784c90775, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:34,597 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): aef988a75cfb01b10fb4b3de9e893b88#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:34,612 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112235c359b6c9d94a128374d3dcbf0c45bd_del 2023-11-22 10:55:34,612 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112235c359b6c9d94a128374d3dcbf0c45bd_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112235c359b6c9d94a128374d3dcbf0c45bd_del 2023-11-22 10:55:34,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa] to archive 2023-11-22 10:55:34,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:34,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/959e52584e3c4f349c431aa9fe3bb23f 2023-11-22 10:55:34,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/650191bfebfc497294821939174de967 2023-11-22 10:55:34,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/1503832fe2724d778d6701a8bd97d8a5 2023-11-22 10:55:34,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/17eb4de28ad54c9194bb17686cc656c9 2023-11-22 10:55:34,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family2/a253f30334f24ba987c55a17a8cfa1aa 2023-11-22 10:55:35,426 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cec912f399c445fd8bbaeb5ffe22b09f 2023-11-22 10:55:35,426 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family1/cec912f399c445fd8bbaeb5ffe22b09f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/cec912f399c445fd8bbaeb5ffe22b09f 2023-11-22 10:55:35,431 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cec912f399c445fd8bbaeb5ffe22b09f 2023-11-22 10:55:35,432 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aef988a75cfb01b10fb4b3de9e893b88/family1 of aef988a75cfb01b10fb4b3de9e893b88 into cec912f399c445fd8bbaeb5ffe22b09f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:35,432 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:35,432 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:35,432 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): aef988a75cfb01b10fb4b3de9e893b88/family2 is initiating major compaction (all files) 2023-11-22 10:55:35,432 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:35,432 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:35,432 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of aef988a75cfb01b10fb4b3de9e893b88/family2 in ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:55:35,432 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp, totalSize=25.3 K 2023-11-22 10:55:35,433 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 6786d504d8884f119e35b3cd05ba086d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524275 2023-11-22 10:55:35,433 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a82b834694e44d51ac2efd0a8dbc4b3a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526078 2023-11-22 10:55:35,434 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 45a53b9ab8174a67ae000ac417a26e4e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:35,434 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting becc148503f54f3790672176c5854ee5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528898 2023-11-22 10:55:35,434 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a4b63fb45d4641539a199eeef7fa0933, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:35,449 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): aef988a75cfb01b10fb4b3de9e893b88#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:35,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775] to archive 2023-11-22 10:55:35,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:35,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/fe04f6c32040412b8d08453340324db0 2023-11-22 10:55:35,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/97d5bce4e64341a28575e20f11b7d443 2023-11-22 10:55:35,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/3e27dca8bb5e4242a262081dae2863c8 2023-11-22 10:55:35,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5ea31e1a1bc7494bbdac87c5577a6ad2 2023-11-22 10:55:35,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/f43f976cbac24dd48169306784c90775 2023-11-22 10:55:35,860 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231122c925782c2196465cbd3a1802d67866e3_del 2023-11-22 10:55:35,860 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122c925782c2196465cbd3a1802d67866e3_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231122c925782c2196465cbd3a1802d67866e3_del 2023-11-22 10:55:36,676 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d16e30a51a48d69b1e634399ba28ac 2023-11-22 10:55:36,677 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/.tmp/family2/71d16e30a51a48d69b1e634399ba28ac as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/71d16e30a51a48d69b1e634399ba28ac 2023-11-22 10:55:36,680 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d16e30a51a48d69b1e634399ba28ac 2023-11-22 10:55:36,681 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aef988a75cfb01b10fb4b3de9e893b88/family2 of aef988a75cfb01b10fb4b3de9e893b88 into 71d16e30a51a48d69b1e634399ba28ac(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:36,681 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:36,681 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:36,681 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 3d37bf20b62569aeda6c03678e88a02e/family1 is initiating major compaction (all files) 2023-11-22 10:55:36,681 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:36,681 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:36,682 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 3d37bf20b62569aeda6c03678e88a02e/family1 in ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:36,682 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp, totalSize=26.6 K 2023-11-22 10:55:36,683 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 3093f09ca25643bb985c548b1df52fee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524276 2023-11-22 10:55:36,683 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 23702cbd9c4c4b3c83a21d60f814eb3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526079 2023-11-22 10:55:36,683 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 7dad0a2838bc4e86a107d92c71584030, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:36,683 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 2cd18d92298644d09df2fd5838ebaeba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528899 2023-11-22 10:55:36,684 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 7fe0299adcc94c50bd93b822bc040cb9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:36,692 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 3d37bf20b62569aeda6c03678e88a02e#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:36,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933] to archive 2023-11-22 10:55:36,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:36,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/6786d504d8884f119e35b3cd05ba086d 2023-11-22 10:55:36,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a82b834694e44d51ac2efd0a8dbc4b3a 2023-11-22 10:55:36,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/45a53b9ab8174a67ae000ac417a26e4e 2023-11-22 10:55:36,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/becc148503f54f3790672176c5854ee5 2023-11-22 10:55:36,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family2/a4b63fb45d4641539a199eeef7fa0933 2023-11-22 10:55:37,100 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112248f2087e5dc4485a8f8b06865c0dbac7_del 2023-11-22 10:55:37,101 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112248f2087e5dc4485a8f8b06865c0dbac7_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112248f2087e5dc4485a8f8b06865c0dbac7_del 2023-11-22 10:55:37,914 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae147b6881c947589758af69384b334f 2023-11-22 10:55:37,915 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family1/ae147b6881c947589758af69384b334f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/ae147b6881c947589758af69384b334f 2023-11-22 10:55:37,918 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae147b6881c947589758af69384b334f 2023-11-22 10:55:37,919 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3d37bf20b62569aeda6c03678e88a02e/family1 of 3d37bf20b62569aeda6c03678e88a02e into ae147b6881c947589758af69384b334f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:55:37,919 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:37,919 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:37,919 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 3d37bf20b62569aeda6c03678e88a02e/family2 is initiating major compaction (all files) 2023-11-22 10:55:37,919 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:37,920 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:37,920 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 3d37bf20b62569aeda6c03678e88a02e/family2 in ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:55:37,920 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp, totalSize=25.3 K 2023-11-22 10:55:37,920 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 72f1188aae264110b48d366995018005, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650524276 2023-11-22 10:55:37,921 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 3df2974287404a7daae442f93b173ece, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650526079 2023-11-22 10:55:37,921 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 9fa8736b3cab4631a14081b2c84a830a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650527470 2023-11-22 10:55:37,921 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 8ecae873b48b45318015aa127f738ad2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650528899 2023-11-22 10:55:37,922 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 936478d67f91473da568e749a29c6bf3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:37,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9] to archive 2023-11-22 10:55:37,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:37,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/3093f09ca25643bb985c548b1df52fee 2023-11-22 10:55:37,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/23702cbd9c4c4b3c83a21d60f814eb3f 2023-11-22 10:55:37,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7dad0a2838bc4e86a107d92c71584030 2023-11-22 10:55:37,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/2cd18d92298644d09df2fd5838ebaeba 2023-11-22 10:55:37,935 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 3d37bf20b62569aeda6c03678e88a02e#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:55:37,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/7fe0299adcc94c50bd93b822bc040cb9 2023-11-22 10:55:38,346 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231122c7bf2532c2964bdfa6928e994ed06952_del 2023-11-22 10:55:38,346 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122c7bf2532c2964bdfa6928e994ed06952_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231122c7bf2532c2964bdfa6928e994ed06952_del 2023-11-22 10:55:38,760 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 932eea397b4448618c0ce72d3bf702c0 2023-11-22 10:55:38,761 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/.tmp/family2/932eea397b4448618c0ce72d3bf702c0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/932eea397b4448618c0ce72d3bf702c0 2023-11-22 10:55:38,764 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 932eea397b4448618c0ce72d3bf702c0 2023-11-22 10:55:38,765 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3d37bf20b62569aeda6c03678e88a02e/family2 of 3d37bf20b62569aeda6c03678e88a02e into 932eea397b4448618c0ce72d3bf702c0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:38,765 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:38,768 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:38,771 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:38,774 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:38,775 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:38,780 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:55:38,794 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-22 10:55:38,797 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112235c359b6c9d94a128374d3dcbf0c45bd_del 2023-11-22 10:55:38,800 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112248f2087e5dc4485a8f8b06865c0dbac7_del 2023-11-22 10:55:38,803 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311222419dc6f8d4e4f55a07e97e7907875be_del 2023-11-22 10:55:38,803 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:38,804 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(139): Connect 0x7843fbf0 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:38,809 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37656ecb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:38,811 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:38,811 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:38,811 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:38,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3] to archive 2023-11-22 10:55:38,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:38,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/72f1188aae264110b48d366995018005 2023-11-22 10:55:38,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/3df2974287404a7daae442f93b173ece 2023-11-22 10:55:38,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/9fa8736b3cab4631a14081b2c84a830a 2023-11-22 10:55:38,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/8ecae873b48b45318015aa127f738ad2 2023-11-22 10:55:38,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family2/936478d67f91473da568e749a29c6bf3 2023-11-22 10:55:39,250 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311222177a19fd4f347a7ab872682fd459d55 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311222177a19fd4f347a7ab872682fd459d55 2023-11-22 10:55:39,250 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122b1fe6c6f4cc142e3aba7e3e007c83def to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231122b1fe6c6f4cc142e3aba7e3e007c83def 2023-11-22 10:55:39,251 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,252 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,271 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:39,274 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:39,280 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:55:39,283 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:55:39,294 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/family1/71667c520dc94056adf608c2befdab67 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-22 10:55:39,295 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/family1/71667c520dc94056adf608c2befdab67}] 2023-11-22 10:55:39,297 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231122/family1/97e43cb239b548f0ac8101ca196c6112 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-22 10:55:39,298 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231122/family1/97e43cb239b548f0ac8101ca196c6112}] 2023-11-22 10:55:39,303 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/family1/71667c520dc94056adf608c2befdab67 for inclusion in aef988a75cfb01b10fb4b3de9e893b88/family1 2023-11-22 10:55:39,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231122/family1/97e43cb239b548f0ac8101ca196c6112 for inclusion in 3d37bf20b62569aeda6c03678e88a02e/family1 2023-11-22 10:55:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-22 10:55:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-22 10:55:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-22 10:55:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-22 10:55:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:55:39,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:55:39,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231122/family1/97e43cb239b548f0ac8101ca196c6112 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__9t2d2mlnmrjidlu5ib0vksa2ea1kikspl1astkak5vlgnim0s94f9bgugocfurk6/family1/97e43cb239b548f0ac8101ca196c6112 2023-11-22 10:55:39,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231122/family1/71667c520dc94056adf608c2befdab67 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__kja2fiq45vkbn2h7j3nerq76e0489vkq5qh529vtht8eefohig3s6fk2o1coa1sg/family1/71667c520dc94056adf608c2befdab67 2023-11-22 10:55:39,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__9t2d2mlnmrjidlu5ib0vksa2ea1kikspl1astkak5vlgnim0s94f9bgugocfurk6/family1/97e43cb239b548f0ac8101ca196c6112 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/d3811e314b6346f5b22b2e6a074fb9d0_SeqId_28_ 2023-11-22 10:55:39,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__9t2d2mlnmrjidlu5ib0vksa2ea1kikspl1astkak5vlgnim0s94f9bgugocfurk6/family1/97e43cb239b548f0ac8101ca196c6112 into 3d37bf20b62569aeda6c03678e88a02e/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/d3811e314b6346f5b22b2e6a074fb9d0_SeqId_28_ - updating store file list. 2023-11-22 10:55:39,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__kja2fiq45vkbn2h7j3nerq76e0489vkq5qh529vtht8eefohig3s6fk2o1coa1sg/family1/71667c520dc94056adf608c2befdab67 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5eec84bf2b3049d083b5d89219aa1095_SeqId_28_ 2023-11-22 10:55:39,311 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__kja2fiq45vkbn2h7j3nerq76e0489vkq5qh529vtht8eefohig3s6fk2o1coa1sg/family1/71667c520dc94056adf608c2befdab67 into aef988a75cfb01b10fb4b3de9e893b88/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5eec84bf2b3049d083b5d89219aa1095_SeqId_28_ - updating store file list. 2023-11-22 10:55:39,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/d3811e314b6346f5b22b2e6a074fb9d0_SeqId_28_ into 3d37bf20b62569aeda6c03678e88a02e/family1 2023-11-22 10:55:39,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__9t2d2mlnmrjidlu5ib0vksa2ea1kikspl1astkak5vlgnim0s94f9bgugocfurk6/family1/97e43cb239b548f0ac8101ca196c6112 into 3d37bf20b62569aeda6c03678e88a02e/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/family1/d3811e314b6346f5b22b2e6a074fb9d0_SeqId_28_) 2023-11-22 10:55:39,316 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5eec84bf2b3049d083b5d89219aa1095_SeqId_28_ into aef988a75cfb01b10fb4b3de9e893b88/family1 2023-11-22 10:55:39,316 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__kja2fiq45vkbn2h7j3nerq76e0489vkq5qh529vtht8eefohig3s6fk2o1coa1sg/family1/71667c520dc94056adf608c2befdab67 into aef988a75cfb01b10fb4b3de9e893b88/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/family1/5eec84bf2b3049d083b5d89219aa1095_SeqId_28_) 2023-11-22 10:55:39,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__9t2d2mlnmrjidlu5ib0vksa2ea1kikspl1astkak5vlgnim0s94f9bgugocfurk6/family1/97e43cb239b548f0ac8101ca196c6112 2023-11-22 10:55:39,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__kja2fiq45vkbn2h7j3nerq76e0489vkq5qh529vtht8eefohig3s6fk2o1coa1sg/family1/71667c520dc94056adf608c2befdab67 2023-11-22 10:55:39,319 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,319 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,320 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:39,320 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:39,321 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112230a8f693b8ea4dbfbade604bef6c32fc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112230a8f693b8ea4dbfbade604bef6c32fc 2023-11-22 10:55:39,322 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-22 10:55:39,322 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231122' 2023-11-22 10:55:39,322 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:39,322 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112253d3b4a6cc04454da0c96c8ef275ebc1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112253d3b4a6cc04454da0c96c8ef275ebc1 2023-11-22 10:55:39,322 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-22 10:55:39,322 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231122' 2023-11-22 10:55:39,323 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:39,646 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112226f900b576564d90872b1332e66fd0aa to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112226f900b576564d90872b1332e66fd0aa 2023-11-22 10:55:39,647 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,674 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b181017a8a15490d8340c035b95ae34c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-22 10:55:39,674 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b181017a8a15490d8340c035b95ae34c}] 2023-11-22 10:55:39,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b181017a8a15490d8340c035b95ae34c for inclusion in ab077d8a9706607380c45654591c8344/family1 2023-11-22 10:55:39,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-22 10:55:39,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-22 10:55:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:55:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231122/family1/b181017a8a15490d8340c035b95ae34c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__3q59adcvhl5ikmtsm5sc8okuevomqlp2aubp78mogr75i4q8jdto7mkrldoch5rn/family1/b181017a8a15490d8340c035b95ae34c 2023-11-22 10:55:39,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__3q59adcvhl5ikmtsm5sc8okuevomqlp2aubp78mogr75i4q8jdto7mkrldoch5rn/family1/b181017a8a15490d8340c035b95ae34c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/3dca089d395640cea8b74d3f3ad46219_SeqId_28_ 2023-11-22 10:55:39,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__3q59adcvhl5ikmtsm5sc8okuevomqlp2aubp78mogr75i4q8jdto7mkrldoch5rn/family1/b181017a8a15490d8340c035b95ae34c into ab077d8a9706607380c45654591c8344/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/3dca089d395640cea8b74d3f3ad46219_SeqId_28_ - updating store file list. 2023-11-22 10:55:39,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/3dca089d395640cea8b74d3f3ad46219_SeqId_28_ into ab077d8a9706607380c45654591c8344/family1 2023-11-22 10:55:39,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__3q59adcvhl5ikmtsm5sc8okuevomqlp2aubp78mogr75i4q8jdto7mkrldoch5rn/family1/b181017a8a15490d8340c035b95ae34c into ab077d8a9706607380c45654591c8344/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/family1/3dca089d395640cea8b74d3f3ad46219_SeqId_28_) 2023-11-22 10:55:39,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__ns_testMinorCompaction__3q59adcvhl5ikmtsm5sc8okuevomqlp2aubp78mogr75i4q8jdto7mkrldoch5rn/family1/b181017a8a15490d8340c035b95ae34c 2023-11-22 10:55:39,686 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,687 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:39,688 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231122d5a48ce4ff3b4422bcc32675ecb4dfff to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231122d5a48ce4ff3b4422bcc32675ecb4dfff 2023-11-22 10:55:39,688 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-22 10:55:39,688 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231122' 2023-11-22 10:55:39,689 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231122 for table='ns:testMinorCompaction' and column='family1' 2023-11-22 10:55:39,689 INFO [Listener at localhost/45227] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-22 10:55:39,691 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:39,693 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:39,696 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:39,697 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:39,714 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 291), OpenFileDescriptor=659 (was 795), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 194), ProcessCount=171 (was 171), AvailableMemoryMB=9911 (was 9818) - AvailableMemoryMB LEAK? - 2023-11-22 10:55:39,725 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=171, AvailableMemoryMB=9910 2023-11-22 10:55:39,727 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-22 10:55:39,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:39,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:55:39,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-22 10:55:39,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:55:39,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:39,730 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:39,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c empty. 2023-11-22 10:55:39,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:39,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-22 10:55:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:40,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:40,143 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-22 10:55:40,144 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b29131cfb0e56bd85c37045435b6d18c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:40,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing b29131cfb0e56bd85c37045435b6d18c, disabling compactions & flushes 2023-11-22 10:55:40,549 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. after waiting 0 ms 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,549 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,549 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:40,551 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:55:40,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650540552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650540552"}]},"ts":"1700650540552"} 2023-11-22 10:55:40,554 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-22 10:55:40,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:55:40,554 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650540554"}]},"ts":"1700650540554"} 2023-11-22 10:55:40,555 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-22 10:55:40,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b29131cfb0e56bd85c37045435b6d18c, ASSIGN}] 2023-11-22 10:55:40,561 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b29131cfb0e56bd85c37045435b6d18c, ASSIGN 2023-11-22 10:55:40,561 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b29131cfb0e56bd85c37045435b6d18c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:40,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=b29131cfb0e56bd85c37045435b6d18c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:40,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650540712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650540712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650540712"}]},"ts":"1700650540712"} 2023-11-22 10:55:40,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure b29131cfb0e56bd85c37045435b6d18c, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:40,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:40,865 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:40,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b29131cfb0e56bd85c37045435b6d18c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.', STARTKEY => '', ENDKEY => ''} 2023-11-22 10:55:40,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:40,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,871 INFO [StoreOpener-b29131cfb0e56bd85c37045435b6d18c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,873 DEBUG [StoreOpener-b29131cfb0e56bd85c37045435b6d18c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:40,873 DEBUG [StoreOpener-b29131cfb0e56bd85c37045435b6d18c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:40,873 INFO [StoreOpener-b29131cfb0e56bd85c37045435b6d18c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29131cfb0e56bd85c37045435b6d18c columnFamilyName family1 2023-11-22 10:55:40,875 INFO [StoreOpener-b29131cfb0e56bd85c37045435b6d18c-1] regionserver.HStore(310): Store=b29131cfb0e56bd85c37045435b6d18c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:40,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:55:40,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:40,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b29131cfb0e56bd85c37045435b6d18c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66550609, jitterRate=-0.008318647742271423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-22 10:55:40,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:40,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., pid=114, masterSystemTime=1700650540865 2023-11-22 10:55:40,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:40,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=b29131cfb0e56bd85c37045435b6d18c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:40,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700650540882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650540882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650540882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650540882"}]},"ts":"1700650540882"} 2023-11-22 10:55:40,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=114, resume processing ppid=113 2023-11-22 10:55:40,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure b29131cfb0e56bd85c37045435b6d18c, server=jenkins-hbase4.apache.org,46051,1700650400831 in 169 msec 2023-11-22 10:55:40,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=113, resume processing ppid=112 2023-11-22 10:55:40,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b29131cfb0e56bd85c37045435b6d18c, ASSIGN in 325 msec 2023-11-22 10:55:40,886 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:55:40,886 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650540886"}]},"ts":"1700650540886"} 2023-11-22 10:55:40,887 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-22 10:55:40,890 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:55:40,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1630 sec 2023-11-22 10:55:41,004 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:41,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-22 10:55:41,835 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-22 10:55:41,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:41,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,853 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:41,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:41,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:41,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:41,854 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,854 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,856 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:41,856 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:41,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:41,856 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:41,856 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,857 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:41,858 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:41,858 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:41,858 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:41,860 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:41,860 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:41,860 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:41,860 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:41,861 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-22 10:55:42,283 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130960179a2b67b4f8f973ad8e053460bdb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130960179a2b67b4f8f973ad8e053460bdb 2023-11-22 10:55:42,686 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/d7795e740c974c1d987bb82f49d0b0a9 2023-11-22 10:55:42,690 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/d7795e740c974c1d987bb82f49d0b0a9 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9 2023-11-22 10:55:42,693 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-22 10:55:42,694 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 833ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:42,694 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:42,695 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:42,700 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:42,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:42,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30b55347[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:42,702 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:42,702 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,704 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,704 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:42,704 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:42,704 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:42,704 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,704 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:42,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:42,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:42,705 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,705 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:42,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:42,708 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:42,708 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:42,708 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:42,708 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,708 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:42,710 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,710 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,710 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:42,710 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,712 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,715 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:42,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:42,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:42,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:42,715 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:42,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:42,815 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:42,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:42,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:42,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:42,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,822 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:42,822 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:42,822 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:42,822 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:42,822 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,822 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,824 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:42,824 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:42,824 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:42,824 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,825 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:42,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:42,825 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:42,825 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:42,825 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:42,825 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:42,825 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:42,825 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:42,825 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:42,825 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-22 10:55:43,237 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286f2375fcd654481389dbf1c88224d6bd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286f2375fcd654481389dbf1c88224d6bd 2023-11-22 10:55:43,642 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/4b52f33f03524876996974809ec3a63f 2023-11-22 10:55:43,647 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/4b52f33f03524876996974809ec3a63f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f 2023-11-22 10:55:43,650 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f, entries=1, sequenceid=9, filesize=5.0 K 2023-11-22 10:55:43,651 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 826ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:43,651 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:43,651 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:43,653 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,653 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:43,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:43,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:43,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:43,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6032f1[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:43,655 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:43,655 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,656 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:43,656 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,656 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:43,658 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,658 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:43,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,659 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:43,659 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:43,661 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:43,661 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:43,661 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:43,661 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,661 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:43,662 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,662 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:43,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,662 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:43,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:43,663 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:43,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,664 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,666 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:43,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:55:43,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:43,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:43,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:43,667 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:43,667 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:43,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:43,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:43,767 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:43,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:43,772 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:43,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:43,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,774 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:43,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:43,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:43,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:43,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,775 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,775 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:43,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:43,776 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:43,776 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,777 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,777 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:43,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:43,777 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:43,777 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:43,777 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:43,777 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:43,777 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:43,777 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:43,777 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:43,777 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:44,188 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011a8c7ef212264135a9cfab19ed8d8644 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011a8c7ef212264135a9cfab19ed8d8644 2023-11-22 10:55:44,593 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/37db4972a3024c749e2a8973a76ee9ff 2023-11-22 10:55:44,597 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/37db4972a3024c749e2a8973a76ee9ff as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff 2023-11-22 10:55:44,600 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff, entries=1, sequenceid=13, filesize=4.9 K 2023-11-22 10:55:44,601 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 824ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:44,601 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:44,601 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:44,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:44,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:44,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:44,601 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,604 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:44,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1d3888[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:44,606 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:44,606 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,607 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:44,607 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,607 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:44,609 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,609 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:44,609 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,609 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:44,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:44,611 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:44,611 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:44,611 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:44,611 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,611 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:44,613 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,613 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,613 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:44,613 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,614 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:44,623 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,623 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:44,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:44,624 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:44,724 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:44,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:44,728 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:44,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:44,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,730 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:44,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:44,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:44,730 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:44,731 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,731 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,732 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:44,732 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:44,733 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,733 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:44,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:44,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:44,734 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:44,734 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:44,755 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053c9dbff67b264f99b44c7810e28fbc06 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053c9dbff67b264f99b44c7810e28fbc06 2023-11-22 10:55:44,759 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/c44ba0fd5a4e4286b9866a2f414b7f76 2023-11-22 10:55:44,763 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/c44ba0fd5a4e4286b9866a2f414b7f76 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76 2023-11-22 10:55:44,767 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76, entries=1, sequenceid=17, filesize=4.9 K 2023-11-22 10:55:44,768 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 34ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:44,768 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:44,768 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:44,768 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:44,768 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:44,768 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,768 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:44,768 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:44,770 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,770 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,770 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,770 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:44,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b35c14[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:44,772 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:44,772 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,774 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:44,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:44,774 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,775 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:44,774 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:44,776 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,776 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:44,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,776 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:44,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,776 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:44,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:44,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:44,779 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:44,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:44,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:44,779 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,779 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:44,780 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,780 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:44,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,780 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:44,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:44,781 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,782 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:44,785 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:44,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:44,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:44,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:44,785 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:44,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:44,886 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:44,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:44,890 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,891 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:44,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:44,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:44,891 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:44,892 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,892 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,894 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:44,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:44,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:44,894 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:44,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:44,896 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:44,896 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:44,896 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:44,896 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:44,896 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:45,310 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289e16635ea2394ceab926c88b3dbf746d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512289e16635ea2394ceab926c88b3dbf746d 2023-11-22 10:55:45,715 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/fafa0d5dc235444497249b99921e0317 2023-11-22 10:55:45,719 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/fafa0d5dc235444497249b99921e0317 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317 2023-11-22 10:55:45,722 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317, entries=1, sequenceid=21, filesize=4.9 K 2023-11-22 10:55:45,723 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 827ms, sequenceid=21, compaction requested=true 2023-11-22 10:55:45,723 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:45,723 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:45,725 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:45,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b060c0e[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:45,727 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:45,727 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,728 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:45,728 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,728 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:45,729 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:45,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:45,732 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:45,732 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:45,732 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:45,732 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,732 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:45,734 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,734 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,734 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:45,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:45,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,737 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:45,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:45,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:45,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,740 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:45,739 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:45,740 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:45,740 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,740 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:45,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:45,840 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:45,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:45,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:45,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:45,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,846 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:45,846 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:45,846 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:45,846 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:45,847 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,847 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,848 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,848 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:45,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:45,848 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:45,848 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,849 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:45,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:45,850 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:45,850 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:45,850 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:45,850 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:45,850 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:45,850 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:45,850 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:45,850 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:46,261 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312c65463f2eff4310b2f392dbbee72e04 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c65463f2eff4310b2f392dbbee72e04 2023-11-22 10:55:46,407 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:55:46,667 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/d82ec0ec6eb04f2c8c29d790632807c0 2023-11-22 10:55:46,671 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/d82ec0ec6eb04f2c8c29d790632807c0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0 2023-11-22 10:55:46,674 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0, entries=1, sequenceid=25, filesize=4.9 K 2023-11-22 10:55:46,674 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 824ms, sequenceid=25, compaction requested=true 2023-11-22 10:55:46,674 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:46,674 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:46,676 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,676 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:46,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:46,676 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,677 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:46,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:46,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@763c4625[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:46,678 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:46,678 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,679 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:46,679 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,679 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:46,684 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:46,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:46,687 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:46,687 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:46,687 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:46,687 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,687 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:46,688 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,688 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:46,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,688 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:46,689 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,690 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,692 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,692 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:46,692 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,692 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:46,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:46,692 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:46,692 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:46,693 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:46,693 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:46,793 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:46,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:46,798 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:46,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:46,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,799 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:46,799 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:46,799 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:46,799 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:46,800 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,800 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,802 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:46,802 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:46,803 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:46,803 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,804 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:46,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:46,804 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:46,804 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:46,804 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:47,215 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f46f0d9bcfb64abe872d0cb4a65b3d80 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f46f0d9bcfb64abe872d0cb4a65b3d80 2023-11-22 10:55:47,620 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/99096b35b2684e28b06580987646ede6 2023-11-22 10:55:47,625 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/99096b35b2684e28b06580987646ede6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6 2023-11-22 10:55:47,628 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6, entries=1, sequenceid=29, filesize=4.9 K 2023-11-22 10:55:47,629 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 825ms, sequenceid=29, compaction requested=true 2023-11-22 10:55:47,629 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:47,629 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:47,631 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71e2f912[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:47,632 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:47,633 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,634 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:47,634 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,634 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:47,635 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:47,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:47,637 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:47,638 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:47,638 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:47,638 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,638 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:47,641 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:47,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:47,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:47,641 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,642 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,644 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,644 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,645 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:47,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:47,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:47,645 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:47,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:47,745 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:47,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:47,750 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,751 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:47,751 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:47,751 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:47,751 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:47,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,752 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,753 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,753 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:47,753 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:47,754 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:47,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:47,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:47,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:47,755 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:47,756 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:47,756 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:47,756 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:47,756 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:47,756 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:47,766 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010398a9a5b83cef42ed8c9f402a68b065cd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010398a9a5b83cef42ed8c9f402a68b065cd 2023-11-22 10:55:48,170 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/937def8f52a24bb690780df3fe894850 2023-11-22 10:55:48,175 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/937def8f52a24bb690780df3fe894850 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850 2023-11-22 10:55:48,178 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850, entries=1, sequenceid=33, filesize=4.9 K 2023-11-22 10:55:48,179 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 423ms, sequenceid=33, compaction requested=true 2023-11-22 10:55:48,179 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:48,179 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:48,179 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:48,179 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:48,179 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,179 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:48,179 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:48,181 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,181 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,181 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,181 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:48,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a8a48c6[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:48,183 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:48,183 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,184 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,184 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:48,184 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:48,185 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:48,185 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,185 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:48,186 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,186 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,186 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:48,186 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:48,188 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:48,188 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:48,188 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:48,188 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,188 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:48,190 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,190 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,190 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,190 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,191 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:48,194 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:48,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:48,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:48,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:48,194 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:48,294 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:48,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:48,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:48,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:48,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,301 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:48,301 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:48,301 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:48,301 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:48,301 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,301 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,303 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,303 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:48,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:48,304 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,304 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:48,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:48,305 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:48,305 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:48,305 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:48,716 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072e5bfb07cbbe4e98961dbf487d689bfb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509072e5bfb07cbbe4e98961dbf487d689bfb 2023-11-22 10:55:48,721 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/ac88ec14e8624f1a815d7dcf6327da36 2023-11-22 10:55:48,724 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/ac88ec14e8624f1a815d7dcf6327da36 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36 2023-11-22 10:55:48,727 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36, entries=1, sequenceid=37, filesize=4.9 K 2023-11-22 10:55:48,727 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 422ms, sequenceid=37, compaction requested=true 2023-11-22 10:55:48,728 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:48,728 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:48,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:48,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:48,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:48,728 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:48,733 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,733 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,733 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,733 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:48,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41e74be5[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:48,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:48,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,735 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:48,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:48,736 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:48,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:48,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:48,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:48,737 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,737 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:48,739 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:48,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:48,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:48,739 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,739 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:48,742 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,742 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,742 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:48,743 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:48,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,744 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:48,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:55:48,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:48,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:48,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:48,746 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:48,747 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:48,746 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:48,847 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:48,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:48,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:48,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:48,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,853 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:48,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:48,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-22 10:55:48,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-22 10:55:48,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,853 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,854 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,854 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:48,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:48,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:48,855 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:48,855 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-22 10:55:48,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-22 10:55:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-22 10:55:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-22 10:55:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:48,856 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:48,856 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. started... 2023-11-22 10:55:48,856 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b29131cfb0e56bd85c37045435b6d18c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-22 10:55:49,267 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120542a7e5b22c34f5e976d48fa3149a1e4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542a7e5b22c34f5e976d48fa3149a1e4 2023-11-22 10:55:49,271 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/a45c5cefd9c54192968c547cfc331985 2023-11-22 10:55:49,275 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/a45c5cefd9c54192968c547cfc331985 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985 2023-11-22 10:55:49,279 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985, entries=1, sequenceid=41, filesize=4.9 K 2023-11-22 10:55:49,280 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b29131cfb0e56bd85c37045435b6d18c in 424ms, sequenceid=41, compaction requested=true 2023-11-22 10:55:49,280 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:49,280 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-22 10:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-22 10:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-22 10:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-22 10:55:49,282 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-22 10:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55fe3092[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:49,284 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-22 10:55:49,284 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,286 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-22 10:55:49,287 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-22 10:55:49,287 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:49,287 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,287 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-22 10:55:49,288 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-22 10:55:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-22 10:55:49,291 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-22 10:55:49,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:49,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:49,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,291 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:49,293 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,293 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:49,293 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:49,294 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,295 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:49,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-22 10:55:49,297 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:49,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:49,297 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-22 10:55:49,297 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:49,297 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:49,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:49,298 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:49,298 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:49,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:49,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:49,398 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:49,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:49,400 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-22 10:55:49,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:55:49,402 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:55:49,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:55:49,403 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651149403 2023-11-22 10:55:49,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-22 10:55:49,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-22 10:55:49,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:49,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x7e714ceb to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:55:49,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2de1f74c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:55:49,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:49,835 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010323a75fa664bb476eba60c088f8dde477 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010323a75fa664bb476eba60c088f8dde477 2023-11-22 10:55:49,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:49,848 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:55:49,851 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:55:49,857 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:55:49,858 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:55:49,865 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b84f961a7080429684f3a1518217e69d first=Optional[r5] last=Optional[r6] 2023-11-22 10:55:49,866 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b84f961a7080429684f3a1518217e69d}] 2023-11-22 10:55:49,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b84f961a7080429684f3a1518217e69d for inclusion in b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:49,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-22 10:55:49,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:55:49,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:49,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b84f961a7080429684f3a1518217e69d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o6o49nbviv6qhtvkieofcjsmqb017p9khpk9k631at1st2fdarubuon8val83qcu/family1/b84f961a7080429684f3a1518217e69d 2023-11-22 10:55:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o6o49nbviv6qhtvkieofcjsmqb017p9khpk9k631at1st2fdarubuon8val83qcu/family1/b84f961a7080429684f3a1518217e69d as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_ 2023-11-22 10:55:49,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o6o49nbviv6qhtvkieofcjsmqb017p9khpk9k631at1st2fdarubuon8val83qcu/family1/b84f961a7080429684f3a1518217e69d into b29131cfb0e56bd85c37045435b6d18c/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_ - updating store file list. 2023-11-22 10:55:49,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_ into b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:49,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o6o49nbviv6qhtvkieofcjsmqb017p9khpk9k631at1st2fdarubuon8val83qcu/family1/b84f961a7080429684f3a1518217e69d into b29131cfb0e56bd85c37045435b6d18c/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_) 2023-11-22 10:55:49,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o6o49nbviv6qhtvkieofcjsmqb017p9khpk9k631at1st2fdarubuon8val83qcu/family1/b84f961a7080429684f3a1518217e69d 2023-11-22 10:55:49,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-22 10:55:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-22 10:55:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): b29131cfb0e56bd85c37045435b6d18c/family1 is initiating minor compaction 2023-11-22 10:55:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@350822da; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:49,882 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b29131cfb0e56bd85c37045435b6d18c/family1 in testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:49,882 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp, totalSize=49.7 K 2023-11-22 10:55:49,882 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 4b52f33f03524876996974809ec3a63f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 37db4972a3024c749e2a8973a76ee9ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting c44ba0fd5a4e4286b9866a2f414b7f76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting fafa0d5dc235444497249b99921e0317, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d82ec0ec6eb04f2c8c29d790632807c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 99096b35b2684e28b06580987646ede6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 937def8f52a24bb690780df3fe894850, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting ac88ec14e8624f1a815d7dcf6327da36, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting a45c5cefd9c54192968c547cfc331985, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-22 10:55:49,883 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 422baff1685a4db1b0950f62e957afff_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-22 10:55:49,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:49,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:49,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f46f0d9bcfb64abe872d0cb4a65b3d80 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f46f0d9bcfb64abe872d0cb4a65b3d80 2023-11-22 10:55:49,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010398a9a5b83cef42ed8c9f402a68b065cd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010398a9a5b83cef42ed8c9f402a68b065cd 2023-11-22 10:55:49,887 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-22 10:55:49,887 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-22 10:55:49,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:49,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:49,911 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b29131cfb0e56bd85c37045435b6d18c#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-22 10:55:49,948 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/2a39212e33a0459a81b2aa0e636240dd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/2a39212e33a0459a81b2aa0e636240dd 2023-11-22 10:55:49,953 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b29131cfb0e56bd85c37045435b6d18c/family1 of b29131cfb0e56bd85c37045435b6d18c into 2a39212e33a0459a81b2aa0e636240dd(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:49,953 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:49,953 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700650549882; duration=0sec 2023-11-22 10:55:49,954 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:50,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_] to archive 2023-11-22 10:55:50,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:50,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/4b52f33f03524876996974809ec3a63f 2023-11-22 10:55:50,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/37db4972a3024c749e2a8973a76ee9ff 2023-11-22 10:55:50,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/c44ba0fd5a4e4286b9866a2f414b7f76 2023-11-22 10:55:50,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/fafa0d5dc235444497249b99921e0317 2023-11-22 10:55:50,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d82ec0ec6eb04f2c8c29d790632807c0 2023-11-22 10:55:50,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/99096b35b2684e28b06580987646ede6 2023-11-22 10:55:50,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/937def8f52a24bb690780df3fe894850 2023-11-22 10:55:50,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ac88ec14e8624f1a815d7dcf6327da36 2023-11-22 10:55:50,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/a45c5cefd9c54192968c547cfc331985 2023-11-22 10:55:50,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/422baff1685a4db1b0950f62e957afff_SeqId_44_ 2023-11-22 10:55:50,354 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311d686972408b446f8ff61c8cd9b5820a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512311d686972408b446f8ff61c8cd9b5820a 2023-11-22 10:55:50,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:50,380 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15bb41450cb749d193afcd12ad0fe4c6 first=Optional[r1] last=Optional[r4] 2023-11-22 10:55:50,381 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15bb41450cb749d193afcd12ad0fe4c6}] 2023-11-22 10:55:50,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15bb41450cb749d193afcd12ad0fe4c6 for inclusion in b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:50,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-22 10:55:50,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:55:50,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:50,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15bb41450cb749d193afcd12ad0fe4c6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bmcmehmbjufrsu5kldo0qhso2h9dalte9q3qq08j3l25f1gails3t1bq3e4mbhak/family1/15bb41450cb749d193afcd12ad0fe4c6 2023-11-22 10:55:50,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bmcmehmbjufrsu5kldo0qhso2h9dalte9q3qq08j3l25f1gails3t1bq3e4mbhak/family1/15bb41450cb749d193afcd12ad0fe4c6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_ 2023-11-22 10:55:50,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bmcmehmbjufrsu5kldo0qhso2h9dalte9q3qq08j3l25f1gails3t1bq3e4mbhak/family1/15bb41450cb749d193afcd12ad0fe4c6 into b29131cfb0e56bd85c37045435b6d18c/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_ - updating store file list. 2023-11-22 10:55:50,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_ into b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:50,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bmcmehmbjufrsu5kldo0qhso2h9dalte9q3qq08j3l25f1gails3t1bq3e4mbhak/family1/15bb41450cb749d193afcd12ad0fe4c6 into b29131cfb0e56bd85c37045435b6d18c/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_) 2023-11-22 10:55:50,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bmcmehmbjufrsu5kldo0qhso2h9dalte9q3qq08j3l25f1gails3t1bq3e4mbhak/family1/15bb41450cb749d193afcd12ad0fe4c6 2023-11-22 10:55:50,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-22 10:55:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-22 10:55:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(1912): b29131cfb0e56bd85c37045435b6d18c/family1 is initiating minor compaction (all files) 2023-11-22 10:55:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1856e0b7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:50,396 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b29131cfb0e56bd85c37045435b6d18c/family1 in testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:55:50,396 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/2a39212e33a0459a81b2aa0e636240dd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp, totalSize=178.1 K 2023-11-22 10:55:50,397 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting d7795e740c974c1d987bb82f49d0b0a9, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824734 2023-11-22 10:55:50,397 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting 2a39212e33a0459a81b2aa0e636240dd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224734 2023-11-22 10:55:50,398 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] compactions.Compactor(207): Compacting f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224734 2023-11-22 10:55:50,398 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:50,399 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:50,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011a8c7ef212264135a9cfab19ed8d8644 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011a8c7ef212264135a9cfab19ed8d8644 2023-11-22 10:55:50,401 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053c9dbff67b264f99b44c7810e28fbc06 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053c9dbff67b264f99b44c7810e28fbc06 2023-11-22 10:55:50,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512289e16635ea2394ceab926c88b3dbf746d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512289e16635ea2394ceab926c88b3dbf746d 2023-11-22 10:55:50,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c65463f2eff4310b2f392dbbee72e04 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c65463f2eff4310b2f392dbbee72e04 2023-11-22 10:55:50,404 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-22 10:55:50,404 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-22 10:55:50,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:50,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:50,411 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] throttle.PressureAwareThroughputController(145): b29131cfb0e56bd85c37045435b6d18c#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-22 10:55:50,842 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b17b49a481984c55967ac832a0a55032 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b17b49a481984c55967ac832a0a55032 2023-11-22 10:55:50,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:50,866 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec12e50139f7445ea83c3fbca9042016 first=Optional[r00] last=Optional[r8] 2023-11-22 10:55:50,867 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec12e50139f7445ea83c3fbca9042016}] 2023-11-22 10:55:50,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec12e50139f7445ea83c3fbca9042016 for inclusion in b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-22 10:55:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last= 2023-11-22 10:55:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:50,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec12e50139f7445ea83c3fbca9042016 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4tuhrnk451cr5r3h11gcpq7n3pe8fbd15jto1e37u890q24oijvuoi3e8gkbtmua/family1/ec12e50139f7445ea83c3fbca9042016 2023-11-22 10:55:50,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4tuhrnk451cr5r3h11gcpq7n3pe8fbd15jto1e37u890q24oijvuoi3e8gkbtmua/family1/ec12e50139f7445ea83c3fbca9042016 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ec95426d0bb449449bc0820ed77b5696_SeqId_49_ 2023-11-22 10:55:50,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4tuhrnk451cr5r3h11gcpq7n3pe8fbd15jto1e37u890q24oijvuoi3e8gkbtmua/family1/ec12e50139f7445ea83c3fbca9042016 into b29131cfb0e56bd85c37045435b6d18c/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ec95426d0bb449449bc0820ed77b5696_SeqId_49_ - updating store file list. 2023-11-22 10:55:50,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ec95426d0bb449449bc0820ed77b5696_SeqId_49_ into b29131cfb0e56bd85c37045435b6d18c/family1 2023-11-22 10:55:50,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4tuhrnk451cr5r3h11gcpq7n3pe8fbd15jto1e37u890q24oijvuoi3e8gkbtmua/family1/ec12e50139f7445ea83c3fbca9042016 into b29131cfb0e56bd85c37045435b6d18c/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/ec95426d0bb449449bc0820ed77b5696_SeqId_49_) 2023-11-22 10:55:50,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4tuhrnk451cr5r3h11gcpq7n3pe8fbd15jto1e37u890q24oijvuoi3e8gkbtmua/family1/ec12e50139f7445ea83c3fbca9042016 2023-11-22 10:55:50,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:50,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:50,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542a7e5b22c34f5e976d48fa3149a1e4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542a7e5b22c34f5e976d48fa3149a1e4 2023-11-22 10:55:50,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286f2375fcd654481389dbf1c88224d6bd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286f2375fcd654481389dbf1c88224d6bd 2023-11-22 10:55:50,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130960179a2b67b4f8f973ad8e053460bdb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130960179a2b67b4f8f973ad8e053460bdb 2023-11-22 10:55:50,881 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-22 10:55:50,881 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-22 10:55:50,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:50,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:50,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-22 10:55:50,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-22 10:55:50,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:55:50,884 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-22 10:55:50,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4830 sec 2023-11-22 10:55:51,088 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=263 (was 251) - Thread LEAK? -, OpenFileDescriptor=679 (was 659) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 176), ProcessCount=171 (was 171), AvailableMemoryMB=9908 (was 9910) 2023-11-22 10:55:51,100 INFO [Listener at localhost/45227] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=263, OpenFileDescriptor=679, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=171, AvailableMemoryMB=9906 2023-11-22 10:55:51,119 DEBUG [Listener at localhost/45227] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-22 10:55:51,172 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9C\xF9\xE0\xFE\xD3e^S9\x94\xC7\x12ZeG'"\x10\x96e\xC7#\xC7\x96\xF0\x0F\x83\x8D\xB1\xF5\xD6\x96\x9A\xCF*\x10({\xB9)\x9C\xDA\xFEJ\x84h\x19]\xB7J\x19\xEA2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-22 10:55:51,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-22 10:55:51,175 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-22 10:55:51,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-22 10:55:51,175 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-22 10:55:51,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:51,177 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:51,177 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644 empty. 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f empty. 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee empty. 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:51,180 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:51,181 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-22 10:55:51,234 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/.tmp/family1/dc36f08fa225487086bdc16bd952bb3f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/dc36f08fa225487086bdc16bd952bb3f 2023-11-22 10:55:51,238 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b29131cfb0e56bd85c37045435b6d18c/family1 of b29131cfb0e56bd85c37045435b6d18c into dc36f08fa225487086bdc16bd952bb3f(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:55:51,239 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:55:51,239 INFO [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700650550396; duration=0sec 2023-11-22 10:55:51,239 DEBUG [RS:0;jenkins-hbase4:46051-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-22 10:55:51,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:51,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/2a39212e33a0459a81b2aa0e636240dd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_] to archive 2023-11-22 10:55:51,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:55:51,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/d7795e740c974c1d987bb82f49d0b0a9 2023-11-22 10:55:51,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/2a39212e33a0459a81b2aa0e636240dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/2a39212e33a0459a81b2aa0e636240dd 2023-11-22 10:55:51,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_ to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/family1/f13f28264b634fcf923ab1e5bfa155ab_SeqId_47_ 2023-11-22 10:55:51,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:51,588 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-22 10:55:51,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3957d4f92fe7cb11e03a78d65dbb7cee, NAME => 'testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9C\xF9\xE0\xFE\xD3e^S9\x94\xC7\x12ZeG'"\x10\x96e\xC7#\xC7\x96\xF0\x0F\x83\x8D\xB1\xF5\xD6\x96\x9A\xCF*\x10({\xB9)\x9C\xDA\xFEJ\x84h\x19]\xB7J\x19\xEA2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:51,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4e58e8726a88cb9300f3431c6b54644, NAME => 'testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9C\xF9\xE0\xFE\xD3e^S9\x94\xC7\x12ZeG'"\x10\x96e\xC7#\xC7\x96\xF0\x0F\x83\x8D\xB1\xF5\xD6\x96\x9A\xCF*\x10({\xB9)\x9C\xDA\xFEJ\x84h\x19]\xB7J\x19\xEA2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:51,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => bf02d69021be9e2afcbed635393a482f, NAME => 'testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9C\xF9\xE0\xFE\xD3e^S9\x94\xC7\x12ZeG'"\x10\x96e\xC7#\xC7\x96\xF0\x0F\x83\x8D\xB1\xF5\xD6\x96\x9A\xCF*\x10({\xB9)\x9C\xDA\xFEJ\x84h\x19]\xB7J\x19\xEA2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/.tmp 2023-11-22 10:55:51,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:51,996 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:51,996 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:51,996 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing bf02d69021be9e2afcbed635393a482f, disabling compactions & flushes 2023-11-22 10:55:51,996 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e4e58e8726a88cb9300f3431c6b54644, disabling compactions & flushes 2023-11-22 10:55:51,996 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:51,997 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. after waiting 0 ms 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 3957d4f92fe7cb11e03a78d65dbb7cee, disabling compactions & flushes 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. after waiting 0 ms 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:51,997 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:51,997 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. after waiting 0 ms 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:51,997 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:51,997 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:51,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:51,999 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-22 10:55:52,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650552000"}]},"ts":"1700650552000"} 2023-11-22 10:55:52,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650552000"}]},"ts":"1700650552000"} 2023-11-22 10:55:52,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700650552000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700650552000"}]},"ts":"1700650552000"} 2023-11-22 10:55:52,002 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-22 10:55:52,003 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-22 10:55:52,003 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650552003"}]},"ts":"1700650552003"} 2023-11-22 10:55:52,004 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-22 10:55:52,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e4e58e8726a88cb9300f3431c6b54644, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bf02d69021be9e2afcbed635393a482f, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3957d4f92fe7cb11e03a78d65dbb7cee, ASSIGN}] 2023-11-22 10:55:52,008 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3957d4f92fe7cb11e03a78d65dbb7cee, ASSIGN 2023-11-22 10:55:52,008 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e4e58e8726a88cb9300f3431c6b54644, ASSIGN 2023-11-22 10:55:52,008 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bf02d69021be9e2afcbed635393a482f, ASSIGN 2023-11-22 10:55:52,008 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e4e58e8726a88cb9300f3431c6b54644, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:52,008 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bf02d69021be9e2afcbed635393a482f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:52,008 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3957d4f92fe7cb11e03a78d65dbb7cee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46051,1700650400831; forceNewPlan=false, retain=false 2023-11-22 10:55:52,160 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=bf02d69021be9e2afcbed635393a482f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,160 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e4e58e8726a88cb9300f3431c6b54644, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,160 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3957d4f92fe7cb11e03a78d65dbb7cee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,160 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650552160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650552160"}]},"ts":"1700650552160"} 2023-11-22 10:55:52,160 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700650552160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650552160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650552160"}]},"ts":"1700650552160"} 2023-11-22 10:55:52,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700650552160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700650552160"}]},"ts":"1700650552160"} 2023-11-22 10:55:52,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure e4e58e8726a88cb9300f3431c6b54644, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:52,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure bf02d69021be9e2afcbed635393a482f, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:52,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 3957d4f92fe7cb11e03a78d65dbb7cee, server=jenkins-hbase4.apache.org,46051,1700650400831}] 2023-11-22 10:55:52,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:52,313 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:52,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3957d4f92fe7cb11e03a78d65dbb7cee, NAME => 'testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.', STARTKEY => '2', ENDKEY => ''} 2023-11-22 10:55:52,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:52,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,339 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,340 DEBUG [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1 2023-11-22 10:55:52,340 DEBUG [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1 2023-11-22 10:55:52,340 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3957d4f92fe7cb11e03a78d65dbb7cee columnFamilyName family1 2023-11-22 10:55:52,342 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] regionserver.HStore(310): Store=3957d4f92fe7cb11e03a78d65dbb7cee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,342 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,343 DEBUG [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2 2023-11-22 10:55:52,343 DEBUG [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2 2023-11-22 10:55:52,343 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3957d4f92fe7cb11e03a78d65dbb7cee columnFamilyName family2 2023-11-22 10:55:52,344 INFO [StoreOpener-3957d4f92fe7cb11e03a78d65dbb7cee-1] regionserver.HStore(310): Store=3957d4f92fe7cb11e03a78d65dbb7cee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:52,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:55:52,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:52,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3957d4f92fe7cb11e03a78d65dbb7cee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65719780, jitterRate=-0.020698964595794678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:52,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:52,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee., pid=122, masterSystemTime=1700650552313 2023-11-22 10:55:52,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:52,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:52,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:52,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4e58e8726a88cb9300f3431c6b54644, NAME => 'testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.', STARTKEY => '', ENDKEY => '1'} 2023-11-22 10:55:52,351 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3957d4f92fe7cb11e03a78d65dbb7cee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:52,351 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650552351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650552351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650552351"}]},"ts":"1700650552351"} 2023-11-22 10:55:52,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=122, resume processing ppid=119 2023-11-22 10:55:52,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 3957d4f92fe7cb11e03a78d65dbb7cee, server=jenkins-hbase4.apache.org,46051,1700650400831 in 190 msec 2023-11-22 10:55:52,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3957d4f92fe7cb11e03a78d65dbb7cee, ASSIGN in 348 msec 2023-11-22 10:55:52,372 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,373 DEBUG [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1 2023-11-22 10:55:52,373 DEBUG [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1 2023-11-22 10:55:52,373 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e58e8726a88cb9300f3431c6b54644 columnFamilyName family1 2023-11-22 10:55:52,374 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] regionserver.HStore(310): Store=e4e58e8726a88cb9300f3431c6b54644/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,374 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,375 DEBUG [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2 2023-11-22 10:55:52,375 DEBUG [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2 2023-11-22 10:55:52,375 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e58e8726a88cb9300f3431c6b54644 columnFamilyName family2 2023-11-22 10:55:52,376 INFO [StoreOpener-e4e58e8726a88cb9300f3431c6b54644-1] regionserver.HStore(310): Store=e4e58e8726a88cb9300f3431c6b54644/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:52,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:55:52,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:52,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4e58e8726a88cb9300f3431c6b54644; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62985328, jitterRate=-0.06144547462463379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:52,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:52,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644., pid=120, masterSystemTime=1700650552313 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:52,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:52,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf02d69021be9e2afcbed635393a482f, NAME => 'testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.', STARTKEY => '1', ENDKEY => '2'} 2023-11-22 10:55:52,382 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e4e58e8726a88cb9300f3431c6b54644, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,382 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700650552382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650552382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650552382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650552382"}]},"ts":"1700650552382"} 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=120, resume processing ppid=117 2023-11-22 10:55:52,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure e4e58e8726a88cb9300f3431c6b54644, server=jenkins-hbase4.apache.org,46051,1700650400831 in 221 msec 2023-11-22 10:55:52,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e4e58e8726a88cb9300f3431c6b54644, ASSIGN in 378 msec 2023-11-22 10:55:52,402 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,403 DEBUG [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1 2023-11-22 10:55:52,403 DEBUG [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1 2023-11-22 10:55:52,404 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf02d69021be9e2afcbed635393a482f columnFamilyName family1 2023-11-22 10:55:52,404 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] regionserver.HStore(310): Store=bf02d69021be9e2afcbed635393a482f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,404 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,405 DEBUG [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2 2023-11-22 10:55:52,405 DEBUG [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2 2023-11-22 10:55:52,406 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf02d69021be9e2afcbed635393a482f columnFamilyName family2 2023-11-22 10:55:52,406 INFO [StoreOpener-bf02d69021be9e2afcbed635393a482f-1] regionserver.HStore(310): Store=bf02d69021be9e2afcbed635393a482f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-22 10:55:52,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-22 10:55:52,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf02d69021be9e2afcbed635393a482f 2023-11-22 10:55:52,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-22 10:55:52,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf02d69021be9e2afcbed635393a482f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62379036, jitterRate=-0.07047992944717407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-22 10:55:52,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:52,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f., pid=121, masterSystemTime=1700650552313 2023-11-22 10:55:52,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:52,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:52,412 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=bf02d69021be9e2afcbed635393a482f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:52,412 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700650552412"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700650552412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700650552412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700650552412"}]},"ts":"1700650552412"} 2023-11-22 10:55:52,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=121, resume processing ppid=118 2023-11-22 10:55:52,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure bf02d69021be9e2afcbed635393a482f, server=jenkins-hbase4.apache.org,46051,1700650400831 in 251 msec 2023-11-22 10:55:52,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=118, resume processing ppid=116 2023-11-22 10:55:52,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bf02d69021be9e2afcbed635393a482f, ASSIGN in 408 msec 2023-11-22 10:55:52,416 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-22 10:55:52,416 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700650552416"}]},"ts":"1700650552416"} 2023-11-22 10:55:52,417 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-22 10:55:52,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-22 10:55:52,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2470 sec 2023-11-22 10:55:53,006 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-22 10:55:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-22 10:55:53,281 INFO [Listener at localhost/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-22 10:55:53,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,290 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:53,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-22 10:55:53,291 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-22 10:55:53,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:53,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-22 10:55:53,291 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-22 10:55:53,292 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,292 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,294 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:53,294 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:53,294 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,294 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:53,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,295 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-22 10:55:53,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-22 10:55:53,295 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-22 10:55:53,295 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:53,295 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-22 10:55:53,295 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. started... 2023-11-22 10:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:53,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. started... 2023-11-22 10:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. started... 2023-11-22 10:55:53,296 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf02d69021be9e2afcbed635393a482f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:53,296 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:53,298 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e4e58e8726a88cb9300f3431c6b54644 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:53,297 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3957d4f92fe7cb11e03a78d65dbb7cee 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-22 10:55:53,342 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122ff8f0033754c4c5babef2d357ef641dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122ff8f0033754c4c5babef2d357ef641dd 2023-11-22 10:55:53,357 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/a16f672a87ff406b91287dd8e58029dd 2023-11-22 10:55:53,748 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122e2e27be462ca496d87b407c9c15f803e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122e2e27be462ca496d87b407c9c15f803e 2023-11-22 10:55:53,754 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112217720f9037344b60a6afe8919663726c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112217720f9037344b60a6afe8919663726c 2023-11-22 10:55:53,763 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/b095310f21834a88a725301f0ad1eca0 2023-11-22 10:55:53,768 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/cf6249d39f1c4f449fb9fd630eb3a043 2023-11-22 10:55:53,789 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112242bec4a544754ea1a2cdff215284cac3 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023112242bec4a544754ea1a2cdff215284cac3 2023-11-22 10:55:53,794 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/2b6f79e370994e698ac3676715435af8 2023-11-22 10:55:53,795 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112213d59f3efd134dfc8f3ff3b94e81f1ae to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112213d59f3efd134dfc8f3ff3b94e81f1ae 2023-11-22 10:55:53,797 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/a16f672a87ff406b91287dd8e58029dd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd 2023-11-22 10:55:53,799 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/7e0ea539aa16494f8af9ac427bdbc2eb 2023-11-22 10:55:53,805 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/b095310f21834a88a725301f0ad1eca0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0 2023-11-22 10:55:53,825 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd, entries=4, sequenceid=5, filesize=5.5 K 2023-11-22 10:55:53,826 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/2b6f79e370994e698ac3676715435af8 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8 2023-11-22 10:55:53,828 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311227b34ac42a34e487099b7c052337471da to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311227b34ac42a34e487099b7c052337471da 2023-11-22 10:55:53,830 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:53,831 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3957d4f92fe7cb11e03a78d65dbb7cee in 534ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:53,831 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:53,832 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:53,832 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:53,834 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/ca9b07e6270249e393b95df693556000 2023-11-22 10:55:53,838 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/cf6249d39f1c4f449fb9fd630eb3a043 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043 2023-11-22 10:55:53,840 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0, entries=4, sequenceid=5, filesize=5.5 K 2023-11-22 10:55:53,841 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/7e0ea539aa16494f8af9ac427bdbc2eb as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb 2023-11-22 10:55:53,845 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:53,846 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bf02d69021be9e2afcbed635393a482f in 550ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:53,846 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:53,846 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:53,846 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:53,863 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043, entries=4, sequenceid=5, filesize=5.5 K 2023-11-22 10:55:53,863 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/ca9b07e6270249e393b95df693556000 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000 2023-11-22 10:55:53,867 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000, entries=2, sequenceid=5, filesize=5.1 K 2023-11-22 10:55:53,867 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e4e58e8726a88cb9300f3431c6b54644 in 570ms, sequenceid=5, compaction requested=false 2023-11-22 10:55:53,868 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:53,868 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-22 10:55:53,868 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-22 10:55:53,869 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,869 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:53,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,870 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:53,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-22 10:55:53,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33326956[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:53,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-22 10:55:53,871 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,872 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,873 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-22 10:55:53,873 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-22 10:55:53,873 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:53,873 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,873 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:53,874 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-22 10:55:53,874 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,874 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:53,874 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-22 10:55:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:53,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-22 10:55:53,876 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-22 10:55:53,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:53,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:53,876 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-22 10:55:53,876 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:53,880 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,880 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:53,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,881 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:53,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:53,881 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,882 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,884 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,885 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-22 10:55:53,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:53,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:53,885 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:53,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:53,985 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:53,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:53,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:53,990 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:53,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:53,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-22 10:55:53,992 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-22 10:55:53,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:53,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-22 10:55:53,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-22 10:55:53,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,992 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,993 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,993 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:53,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:53,994 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:53,994 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:53,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-22 10:55:53,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-22 10:55:53,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-22 10:55:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-22 10:55:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-22 10:55:53,995 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:53,995 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:53,995 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. started... 2023-11-22 10:55:53,995 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. started... 2023-11-22 10:55:53,995 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:53,996 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. started... 2023-11-22 10:55:53,996 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf02d69021be9e2afcbed635393a482f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:53,996 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e4e58e8726a88cb9300f3431c6b54644 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:53,996 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3957d4f92fe7cb11e03a78d65dbb7cee 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-22 10:55:54,041 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311221b5563f1b1cb45f5813670654b8b998f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311221b5563f1b1cb45f5813670654b8b998f 2023-11-22 10:55:54,052 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311221e5f447f46454edaa48a2a03923bf6ec to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311221e5f447f46454edaa48a2a03923bf6ec 2023-11-22 10:55:54,053 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122f16bb7eb2aa44245a8b41e9868962ac1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f16bb7eb2aa44245a8b41e9868962ac1 2023-11-22 10:55:54,055 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/5ac1ea898cbd4da99fb8844a259ca628 2023-11-22 10:55:54,068 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/dd22659659b74ea1a972b1b4e61dd616 2023-11-22 10:55:54,075 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/bec84a571bbd4a7dade292b79e366fde 2023-11-22 10:55:54,124 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122119e8d89896d4c72a5676335e13a529e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231122119e8d89896d4c72a5676335e13a529e 2023-11-22 10:55:54,125 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122f56f04ae1b534b93970923ae28c67b4f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231122f56f04ae1b534b93970923ae28c67b4f 2023-11-22 10:55:54,128 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/148b15c891fa4b558d9ec662b4e639c0 2023-11-22 10:55:54,131 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/25e299f1901a42c0b847bb7dd4ed9bbd 2023-11-22 10:55:54,132 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/dd22659659b74ea1a972b1b4e61dd616 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616 2023-11-22 10:55:54,135 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/bec84a571bbd4a7dade292b79e366fde as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde 2023-11-22 10:55:54,158 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde, entries=4, sequenceid=9, filesize=5.5 K 2023-11-22 10:55:54,159 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/25e299f1901a42c0b847bb7dd4ed9bbd as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd 2023-11-22 10:55:54,162 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:54,163 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3957d4f92fe7cb11e03a78d65dbb7cee in 167ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:54,163 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:54,163 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:54,167 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616, entries=4, sequenceid=9, filesize=5.5 K 2023-11-22 10:55:54,168 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/148b15c891fa4b558d9ec662b4e639c0 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0 2023-11-22 10:55:54,171 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:54,172 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e4e58e8726a88cb9300f3431c6b54644 in 176ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:54,172 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:54,172 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:54,172 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:54,509 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122ea29ca2a7604441394a478be9475d510 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231122ea29ca2a7604441394a478be9475d510 2023-11-22 10:55:54,914 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/f69cc6e37e97434c8ddf8c1a4e816096 2023-11-22 10:55:54,918 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/5ac1ea898cbd4da99fb8844a259ca628 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628 2023-11-22 10:55:54,941 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628, entries=4, sequenceid=9, filesize=5.5 K 2023-11-22 10:55:54,941 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/f69cc6e37e97434c8ddf8c1a4e816096 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096 2023-11-22 10:55:54,944 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096, entries=2, sequenceid=9, filesize=5.1 K 2023-11-22 10:55:54,945 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bf02d69021be9e2afcbed635393a482f in 950ms, sequenceid=9, compaction requested=false 2023-11-22 10:55:54,945 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:54,945 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-22 10:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-22 10:55:54,948 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:54,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-22 10:55:54,950 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-22 10:55:54,950 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b66db8e[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:54,951 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,951 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-22 10:55:54,951 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-22 10:55:54,951 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:54,951 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,951 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-22 10:55:54,952 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-22 10:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:54,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-22 10:55:54,955 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-22 10:55:54,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:54,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:54,955 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-22 10:55:54,955 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:54,956 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,956 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,956 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:54,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:54,957 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,958 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,961 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,961 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:54,961 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:54,961 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:54,961 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:54,962 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:54,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-22 10:55:54,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-22 10:55:54,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:54,962 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:54,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:55,062 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:55,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:55,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:55,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:55,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:55,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:55,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:55,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-22 10:55:55,069 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-22 10:55:55,069 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:55,069 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-22 10:55:55,069 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-22 10:55:55,070 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:55,070 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:55,071 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:55,071 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:55,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:55,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:55,071 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:55,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:55,071 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:55,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:55,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:55,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:55,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-22 10:55:55,072 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-22 10:55:55,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-22 10:55:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-22 10:55:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. started... 2023-11-22 10:55:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:55,073 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf02d69021be9e2afcbed635393a482f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. started... 2023-11-22 10:55:55,073 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. started... 2023-11-22 10:55:55,073 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e4e58e8726a88cb9300f3431c6b54644 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:55,073 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3957d4f92fe7cb11e03a78d65dbb7cee 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-22 10:55:55,141 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122f0c8d13445c34a19bc494f89b32cf3dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122f0c8d13445c34a19bc494f89b32cf3dd 2023-11-22 10:55:55,143 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112257e13d2cf6ad456d852e8d996f206bed to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112257e13d2cf6ad456d852e8d996f206bed 2023-11-22 10:55:55,149 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311220c785ec9c1084f9599086c464a73d0f6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311220c785ec9c1084f9599086c464a73d0f6 2023-11-22 10:55:55,159 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93 2023-11-22 10:55:55,166 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/851e03ec67d845a6a7bb496e5ce3d61b 2023-11-22 10:55:55,208 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122f842570f6c5c469c924c33cea913dca2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231122f842570f6c5c469c924c33cea913dca2 2023-11-22 10:55:55,587 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/66bb810d44b44bd78f96c406b29844e4 2023-11-22 10:55:55,606 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311224e7e30386f7641debb6c2234102ebb44 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311224e7e30386f7641debb6c2234102ebb44 2023-11-22 10:55:55,615 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/beb38664398a43698b3304f7b35e6afc 2023-11-22 10:55:55,619 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93 2023-11-22 10:55:55,619 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311223d1a1b4631394d15b08ec6cea1111ee8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311223d1a1b4631394d15b08ec6cea1111ee8 2023-11-22 10:55:55,654 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93, entries=4, sequenceid=13, filesize=5.5 K 2023-11-22 10:55:55,655 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/beb38664398a43698b3304f7b35e6afc as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc 2023-11-22 10:55:55,658 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:55,659 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bf02d69021be9e2afcbed635393a482f in 586ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:55,659 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:55,659 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:56,012 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/f45722a9c450453cb6ebdc6bf3ff351f 2023-11-22 10:55:56,015 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/851e03ec67d845a6a7bb496e5ce3d61b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b 2023-11-22 10:55:56,023 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/b7071af5049b409083db0fa01f902d0b 2023-11-22 10:55:56,027 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/66bb810d44b44bd78f96c406b29844e4 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4 2023-11-22 10:55:56,039 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b, entries=4, sequenceid=13, filesize=5.5 K 2023-11-22 10:55:56,039 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/f45722a9c450453cb6ebdc6bf3ff351f as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f 2023-11-22 10:55:56,043 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:56,043 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3957d4f92fe7cb11e03a78d65dbb7cee in 970ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:56,043 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:56,043 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:56,043 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:56,050 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4, entries=4, sequenceid=13, filesize=5.5 K 2023-11-22 10:55:56,050 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/b7071af5049b409083db0fa01f902d0b as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b 2023-11-22 10:55:56,053 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-22 10:55:56,054 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e4e58e8726a88cb9300f3431c6b54644 in 981ms, sequenceid=13, compaction requested=true 2023-11-22 10:55:56,054 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:56,054 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:56,054 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:56,054 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:56,054 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,054 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-22 10:55:56,054 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-22 10:55:56,056 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,056 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:56,056 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,056 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:56,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-22 10:55:56,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50251564[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:56,058 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-22 10:55:56,058 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,059 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,059 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-22 10:55:56,059 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-22 10:55:56,059 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:56,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,059 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:56,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-22 10:55:56,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:56,061 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,061 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-22 10:55:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:56,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-22 10:55:56,064 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-22 10:55:56,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:56,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:56,064 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-22 10:55:56,064 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:56,065 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,065 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,065 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:56,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:56,066 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,067 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,070 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:56,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-22 10:55:56,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:56,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-22 10:55:56,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:56,070 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:56,170 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:56,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:56,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:56,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:56,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-22 10:55:56,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-22 10:55:56,176 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-22 10:55:56,176 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:56,177 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-22 10:55:56,177 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-22 10:55:56,177 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,177 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:56,178 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,178 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:56,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:56,179 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:56,179 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:56,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:56,179 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-22 10:55:56,180 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-22 10:55:56,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-22 10:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-22 10:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. started... 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. started... 2023-11-22 10:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. started... 2023-11-22 10:55:56,180 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e4e58e8726a88cb9300f3431c6b54644 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:56,180 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3957d4f92fe7cb11e03a78d65dbb7cee 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:56,180 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf02d69021be9e2afcbed635393a482f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-22 10:55:56,234 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:55:56,234 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e714ceb to 127.0.0.1:57046 2023-11-22 10:55:56,234 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:56,235 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:55:56,235 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7843fbf0 to 127.0.0.1:57046 2023-11-22 10:55:56,236 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:55:56,256 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311222d0d513ac5864cc083f5bb187a73d4b5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311222d0d513ac5864cc083f5bb187a73d4b5 2023-11-22 10:55:56,274 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/d74c0d95b10b4068874b5b2bce84d740 2023-11-22 10:55:56,623 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122b60e75e5016547a89f8de3f3196c73d1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122b60e75e5016547a89f8de3f3196c73d1 2023-11-22 10:55:56,625 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122f9f77ce56368453dbf2308833d2becda to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f9f77ce56368453dbf2308833d2becda 2023-11-22 10:55:56,717 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112242a08a7490784ca1896e5c0b28e5d3aa to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023112242a08a7490784ca1896e5c0b28e5d3aa 2023-11-22 10:55:57,039 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/3db4d51dc5cd42e8b472d3e69c08675e 2023-11-22 10:55:57,039 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/e2105badce394c48b164ab0355f1392a 2023-11-22 10:55:57,083 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311224544d4831b3342948a020398bd2e823d to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311224544d4831b3342948a020398bd2e823d 2023-11-22 10:55:57,089 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/0024efca55cc49c9bce1d2c55a0f0f7e 2023-11-22 10:55:57,093 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/3db4d51dc5cd42e8b472d3e69c08675e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e 2023-11-22 10:55:57,117 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e, entries=4, sequenceid=17, filesize=5.5 K 2023-11-22 10:55:57,118 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/0024efca55cc49c9bce1d2c55a0f0f7e as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e 2023-11-22 10:55:57,121 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:57,121 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bf02d69021be9e2afcbed635393a482f in 941ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:57,122 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:57,122 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:57,122 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/e4ea2c65a259420082676ffcb802620a 2023-11-22 10:55:57,126 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/d74c0d95b10b4068874b5b2bce84d740 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740 2023-11-22 10:55:57,148 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740, entries=4, sequenceid=17, filesize=5.5 K 2023-11-22 10:55:57,148 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/e4ea2c65a259420082676ffcb802620a as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a 2023-11-22 10:55:57,152 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:57,152 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e4e58e8726a88cb9300f3431c6b54644 in 972ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:57,152 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:57,152 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:57,152 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:57,472 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311224e4ecedabf34446299486913d21368da to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311224e4ecedabf34446299486913d21368da 2023-11-22 10:55:57,477 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/6a676d17ea244ffcb56cb6586d32338c 2023-11-22 10:55:57,480 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/e2105badce394c48b164ab0355f1392a as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a 2023-11-22 10:55:57,503 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a, entries=4, sequenceid=17, filesize=5.5 K 2023-11-22 10:55:57,504 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/6a676d17ea244ffcb56cb6586d32338c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c 2023-11-22 10:55:57,507 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-22 10:55:57,508 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3957d4f92fe7cb11e03a78d65dbb7cee in 1328ms, sequenceid=17, compaction requested=true 2023-11-22 10:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-22 10:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-22 10:55:57,510 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:57,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-22 10:55:57,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747bc552[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:57,512 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-22 10:55:57,512 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,516 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-22 10:55:57,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-22 10:55:57,516 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,516 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:57,516 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:57,517 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,517 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-22 10:55:57,517 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:57,517 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:57,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-22 10:55:57,520 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-22 10:55:57,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:57,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:57,520 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-22 10:55:57,520 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:57,521 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,521 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,521 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:57,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:57,522 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,523 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:57,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:57,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-22 10:55:57,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-22 10:55:57,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:57,525 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:57,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:57,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:57,525 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:57,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:57,526 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:57,626 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:57,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:57,635 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:57,642 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:57,650 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:55:57,650 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:55:57,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-22 10:55:57,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-22 10:55:57,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-22 10:55:57,733 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-22 10:55:57,733 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:57,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-22 10:55:57,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-22 10:55:57,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,734 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:57,736 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:57,736 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:57,737 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:57,737 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-22 10:55:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:57,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-22 10:55:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:57,737 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-22 10:55:57,737 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-22 10:55:57,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-22 10:55:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-22 10:55:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-22 10:55:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-22 10:55:57,738 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. started... 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:57,738 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf02d69021be9e2afcbed635393a482f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. started... 2023-11-22 10:55:57,738 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. started... 2023-11-22 10:55:57,738 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3957d4f92fe7cb11e03a78d65dbb7cee 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:57,738 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e4e58e8726a88cb9300f3431c6b54644 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-22 10:55:57,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-22 10:55:58,183 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/011bcfa703d44a7ca7a35e9362d78874 2023-11-22 10:55:58,205 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 011bcfa703d44a7ca7a35e9362d78874 2023-11-22 10:55:58,580 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/32723f0ffa0c44c69cebc2d0cd653422 2023-11-22 10:55:58,583 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/c3a9c9930a22454ca2a91baef721ac3c 2023-11-22 10:55:58,606 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3a9c9930a22454ca2a91baef721ac3c 2023-11-22 10:55:58,615 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32723f0ffa0c44c69cebc2d0cd653422 2023-11-22 10:55:58,618 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/a4e7e438fd374117b8efbb19ee0c8577 2023-11-22 10:55:58,621 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4e7e438fd374117b8efbb19ee0c8577 2023-11-22 10:55:58,622 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/011bcfa703d44a7ca7a35e9362d78874 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874 2023-11-22 10:55:58,625 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/61f09635ef874c7398ad4d91d98c1bf1 2023-11-22 10:55:58,627 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61f09635ef874c7398ad4d91d98c1bf1 2023-11-22 10:55:58,628 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/32723f0ffa0c44c69cebc2d0cd653422 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422 2023-11-22 10:55:58,645 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 011bcfa703d44a7ca7a35e9362d78874 2023-11-22 10:55:58,645 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874, entries=3, sequenceid=23, filesize=5.2 K 2023-11-22 10:55:58,646 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/a4e7e438fd374117b8efbb19ee0c8577 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577 2023-11-22 10:55:58,649 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4e7e438fd374117b8efbb19ee0c8577 2023-11-22 10:55:58,649 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:58,650 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32723f0ffa0c44c69cebc2d0cd653422 2023-11-22 10:55:58,650 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e4e58e8726a88cb9300f3431c6b54644 in 912ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:58,650 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422, entries=3, sequenceid=23, filesize=5.2 K 2023-11-22 10:55:58,650 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:55:58,650 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:55:58,650 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-22 10:55:58,650 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/61f09635ef874c7398ad4d91d98c1bf1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1 2023-11-22 10:55:58,653 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61f09635ef874c7398ad4d91d98c1bf1 2023-11-22 10:55:58,653 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:58,654 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3957d4f92fe7cb11e03a78d65dbb7cee in 916ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:58,654 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:55:58,654 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:55:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-22 10:55:59,417 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/c90c54664d1e4caabc864c1c472ac335 2023-11-22 10:55:59,421 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c90c54664d1e4caabc864c1c472ac335 2023-11-22 10:55:59,421 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/c3a9c9930a22454ca2a91baef721ac3c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c 2023-11-22 10:55:59,444 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3a9c9930a22454ca2a91baef721ac3c 2023-11-22 10:55:59,444 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c, entries=3, sequenceid=23, filesize=5.2 K 2023-11-22 10:55:59,445 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/c90c54664d1e4caabc864c1c472ac335 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335 2023-11-22 10:55:59,449 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c90c54664d1e4caabc864c1c472ac335 2023-11-22 10:55:59,449 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335, entries=1, sequenceid=23, filesize=5.0 K 2023-11-22 10:55:59,449 INFO [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bf02d69021be9e2afcbed635393a482f in 1711ms, sequenceid=23, compaction requested=true 2023-11-22 10:55:59,450 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:55:59,450 DEBUG [rs(jenkins-hbase4.apache.org,46051,1700650400831)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-22 10:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-22 10:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-22 10:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-22 10:55:59,452 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,452 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:59,452 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,452 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-22 10:55:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:59,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46051,1700650400831' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-22 10:55:59,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a36a52[Count = 0] remaining members to acquire global barrier 2023-11-22 10:55:59,453 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-22 10:55:59,454 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,455 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-22 10:55:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-22 10:55:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46051,1700650400831' in zk 2023-11-22 10:55:59,455 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,455 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-22 10:55:59,456 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-22 10:55:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,46051,1700650400831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-22 10:55:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:59,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46051,1700650400831': 2023-11-22 10:55:59,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46051,1700650400831' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-22 10:55:59,459 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-22 10:55:59,459 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-22 10:55:59,459 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-22 10:55:59,459 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-22 10:55:59,459 INFO [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-22 10:55:59,461 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-22 10:55:59,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-22 10:55:59,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:59,462 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-22 10:55:59,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,463 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-22 10:55:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-22 10:55:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-22 10:55:59,466 DEBUG [(jenkins-hbase4.apache.org,41509,1700650399619)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-22 10:55:59,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-22 10:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-22 10:55:59,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-22 10:55:59,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-22 10:55:59,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-22 10:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-22 10:55:59,466 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-22 10:55:59,467 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-22 10:55:59,567 DEBUG [Listener at localhost/45227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-22 10:55:59,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41509] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-22 10:55:59,568 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:55:59,568 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): bf02d69021be9e2afcbed635393a482f/family1 is initiating major compaction (all files) 2023-11-22 10:55:59,568 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:55:59,568 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:55:59,570 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of bf02d69021be9e2afcbed635393a482f/family1 in testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:55:59,570 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp, totalSize=27.1 K 2023-11-22 10:55:59,571 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting b095310f21834a88a725301f0ad1eca0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553287 2023-11-22 10:55:59,571 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 5ac1ea898cbd4da99fb8844a259ca628, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553988 2023-11-22 10:55:59,571 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 2eb0cb3e4ed64c36a8fcdaef1ba47f93, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:55:59,571 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 3db4d51dc5cd42e8b472d3e69c08675e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556173 2023-11-22 10:55:59,572 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting c3a9c9930a22454ca2a91baef721ac3c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:55:59,580 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): bf02d69021be9e2afcbed635393a482f#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:00,018 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del 2023-11-22 10:56:00,018 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del 2023-11-22 10:56:00,469 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0c29ab11c8478780656e834185c8e6 2023-11-22 10:56:00,470 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family1/de0c29ab11c8478780656e834185c8e6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/de0c29ab11c8478780656e834185c8e6 2023-11-22 10:56:00,491 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0c29ab11c8478780656e834185c8e6 2023-11-22 10:56:00,492 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bf02d69021be9e2afcbed635393a482f/family1 of bf02d69021be9e2afcbed635393a482f into de0c29ab11c8478780656e834185c8e6(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:56:00,492 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:56:00,492 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:56:00,492 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): bf02d69021be9e2afcbed635393a482f/family2 is initiating major compaction (all files) 2023-11-22 10:56:00,492 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:56:00,492 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:56:00,492 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of bf02d69021be9e2afcbed635393a482f/family2 in testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:00,492 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp, totalSize=25.4 K 2023-11-22 10:56:00,493 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 7e0ea539aa16494f8af9ac427bdbc2eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553287 2023-11-22 10:56:00,493 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting f69cc6e37e97434c8ddf8c1a4e816096, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553988 2023-11-22 10:56:00,493 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting beb38664398a43698b3304f7b35e6afc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:56:00,494 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 0024efca55cc49c9bce1d2c55a0f0f7e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556173 2023-11-22 10:56:00,494 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting c90c54664d1e4caabc864c1c472ac335, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:56:00,501 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): bf02d69021be9e2afcbed635393a482f#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:00,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c] to archive 2023-11-22 10:56:00,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:00,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/b095310f21834a88a725301f0ad1eca0 2023-11-22 10:56:00,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/5ac1ea898cbd4da99fb8844a259ca628 2023-11-22 10:56:00,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/2eb0cb3e4ed64c36a8fcdaef1ba47f93 2023-11-22 10:56:00,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/3db4d51dc5cd42e8b472d3e69c08675e 2023-11-22 10:56:00,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/c3a9c9930a22454ca2a91baef721ac3c 2023-11-22 10:56:00,909 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311221c71a4d5c33f4d0586b33c8e0b5cc193_del 2023-11-22 10:56:00,909 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311221c71a4d5c33f4d0586b33c8e0b5cc193_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311221c71a4d5c33f4d0586b33c8e0b5cc193_del 2023-11-22 10:56:01,721 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d907b4eb9eaa4bedb1fc4d749025b7c6 2023-11-22 10:56:01,722 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/.tmp/family2/d907b4eb9eaa4bedb1fc4d749025b7c6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/d907b4eb9eaa4bedb1fc4d749025b7c6 2023-11-22 10:56:01,725 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d907b4eb9eaa4bedb1fc4d749025b7c6 2023-11-22 10:56:01,726 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bf02d69021be9e2afcbed635393a482f/family2 of bf02d69021be9e2afcbed635393a482f into d907b4eb9eaa4bedb1fc4d749025b7c6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:56:01,726 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:56:01,726 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:56:01,726 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 3957d4f92fe7cb11e03a78d65dbb7cee/family1 is initiating major compaction (all files) 2023-11-22 10:56:01,726 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:56:01,727 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:56:01,727 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 3957d4f92fe7cb11e03a78d65dbb7cee/family1 in testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:01,727 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp, totalSize=27.1 K 2023-11-22 10:56:01,727 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a16f672a87ff406b91287dd8e58029dd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553288 2023-11-22 10:56:01,727 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting bec84a571bbd4a7dade292b79e366fde, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553988 2023-11-22 10:56:01,728 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 851e03ec67d845a6a7bb496e5ce3d61b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:56:01,728 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting e2105badce394c48b164ab0355f1392a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556173 2023-11-22 10:56:01,728 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 32723f0ffa0c44c69cebc2d0cd653422, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:56:01,736 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 3957d4f92fe7cb11e03a78d65dbb7cee#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:01,772 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del 2023-11-22 10:56:01,772 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del 2023-11-22 10:56:01,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335] to archive 2023-11-22 10:56:01,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:01,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/7e0ea539aa16494f8af9ac427bdbc2eb 2023-11-22 10:56:01,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/f69cc6e37e97434c8ddf8c1a4e816096 2023-11-22 10:56:01,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/beb38664398a43698b3304f7b35e6afc 2023-11-22 10:56:01,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/0024efca55cc49c9bce1d2c55a0f0f7e 2023-11-22 10:56:01,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family2/c90c54664d1e4caabc864c1c472ac335 2023-11-22 10:56:02,223 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9c6a220bb6d42fa9194990a384ebc20 2023-11-22 10:56:02,224 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family1/f9c6a220bb6d42fa9194990a384ebc20 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/f9c6a220bb6d42fa9194990a384ebc20 2023-11-22 10:56:02,246 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9c6a220bb6d42fa9194990a384ebc20 2023-11-22 10:56:02,247 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3957d4f92fe7cb11e03a78d65dbb7cee/family1 of 3957d4f92fe7cb11e03a78d65dbb7cee into f9c6a220bb6d42fa9194990a384ebc20(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:56:02,247 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:56:02,247 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:56:02,247 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): 3957d4f92fe7cb11e03a78d65dbb7cee/family2 is initiating major compaction (all files) 2023-11-22 10:56:02,247 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:56:02,247 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:56:02,247 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of 3957d4f92fe7cb11e03a78d65dbb7cee/family2 in testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:02,248 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp, totalSize=25.4 K 2023-11-22 10:56:02,248 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 2b6f79e370994e698ac3676715435af8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553288 2023-11-22 10:56:02,248 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 25e299f1901a42c0b847bb7dd4ed9bbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553988 2023-11-22 10:56:02,248 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting f45722a9c450453cb6ebdc6bf3ff351f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:56:02,249 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 6a676d17ea244ffcb56cb6586d32338c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556173 2023-11-22 10:56:02,249 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 61f09635ef874c7398ad4d91d98c1bf1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:56:02,257 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): 3957d4f92fe7cb11e03a78d65dbb7cee#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:02,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422] to archive 2023-11-22 10:56:02,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:02,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/a16f672a87ff406b91287dd8e58029dd 2023-11-22 10:56:02,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/bec84a571bbd4a7dade292b79e366fde 2023-11-22 10:56:02,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/851e03ec67d845a6a7bb496e5ce3d61b 2023-11-22 10:56:02,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/e2105badce394c48b164ab0355f1392a 2023-11-22 10:56:02,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/32723f0ffa0c44c69cebc2d0cd653422 2023-11-22 10:56:02,664 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231122a945408d14774e1fab0a56386d29519e_del 2023-11-22 10:56:02,664 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231122a945408d14774e1fab0a56386d29519e_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231122a945408d14774e1fab0a56386d29519e_del 2023-11-22 10:56:03,477 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d5f6e30948457dacb88d83201784b6 2023-11-22 10:56:03,478 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/.tmp/family2/e0d5f6e30948457dacb88d83201784b6 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/e0d5f6e30948457dacb88d83201784b6 2023-11-22 10:56:03,481 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d5f6e30948457dacb88d83201784b6 2023-11-22 10:56:03,482 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3957d4f92fe7cb11e03a78d65dbb7cee/family2 of 3957d4f92fe7cb11e03a78d65dbb7cee into e0d5f6e30948457dacb88d83201784b6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-22 10:56:03,482 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:56:03,482 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:56:03,482 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): e4e58e8726a88cb9300f3431c6b54644/family1 is initiating major compaction (all files) 2023-11-22 10:56:03,482 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:56:03,482 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:56:03,482 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of e4e58e8726a88cb9300f3431c6b54644/family1 in testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:03,483 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp, totalSize=27.1 K 2023-11-22 10:56:03,483 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting cf6249d39f1c4f449fb9fd630eb3a043, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553287 2023-11-22 10:56:03,483 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting dd22659659b74ea1a972b1b4e61dd616, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553987 2023-11-22 10:56:03,484 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 66bb810d44b44bd78f96c406b29844e4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:56:03,484 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting d74c0d95b10b4068874b5b2bce84d740, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556172 2023-11-22 10:56:03,484 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 011bcfa703d44a7ca7a35e9362d78874, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:56:03,491 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): e4e58e8726a88cb9300f3431c6b54644#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:03,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1] to archive 2023-11-22 10:56:03,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:03,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/2b6f79e370994e698ac3676715435af8 2023-11-22 10:56:03,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/25e299f1901a42c0b847bb7dd4ed9bbd 2023-11-22 10:56:03,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/f45722a9c450453cb6ebdc6bf3ff351f 2023-11-22 10:56:03,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/6a676d17ea244ffcb56cb6586d32338c 2023-11-22 10:56:03,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family2/61f09635ef874c7398ad4d91d98c1bf1 2023-11-22 10:56:03,937 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del 2023-11-22 10:56:03,937 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del 2023-11-22 10:56:04,388 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5faa9b173aa4a8aa775d095b73abd49 2023-11-22 10:56:04,389 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family1/c5faa9b173aa4a8aa775d095b73abd49 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/c5faa9b173aa4a8aa775d095b73abd49 2023-11-22 10:56:04,410 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5faa9b173aa4a8aa775d095b73abd49 2023-11-22 10:56:04,411 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e4e58e8726a88cb9300f3431c6b54644/family1 of e4e58e8726a88cb9300f3431c6b54644 into c5faa9b173aa4a8aa775d095b73abd49(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:56:04,411 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:56:04,411 DEBUG [Listener at localhost/45227] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-22 10:56:04,411 DEBUG [Listener at localhost/45227] regionserver.HStore(1912): e4e58e8726a88cb9300f3431c6b54644/family2 is initiating major compaction (all files) 2023-11-22 10:56:04,411 INFO [Listener at localhost/45227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-22 10:56:04,411 INFO [Listener at localhost/45227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-22 10:56:04,411 INFO [Listener at localhost/45227] regionserver.HRegion(2259): Starting compaction of e4e58e8726a88cb9300f3431c6b54644/family2 in testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:04,412 INFO [Listener at localhost/45227] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577] into tmpdir=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp, totalSize=25.4 K 2023-11-22 10:56:04,412 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting ca9b07e6270249e393b95df693556000, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700650553287 2023-11-22 10:56:04,412 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting 148b15c891fa4b558d9ec662b4e639c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700650553987 2023-11-22 10:56:04,413 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting b7071af5049b409083db0fa01f902d0b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700650555065 2023-11-22 10:56:04,413 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting e4ea2c65a259420082676ffcb802620a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700650556172 2023-11-22 10:56:04,413 DEBUG [Listener at localhost/45227] compactions.Compactor(207): Compacting a4e7e438fd374117b8efbb19ee0c8577, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-22 10:56:04,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874] to archive 2023-11-22 10:56:04,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:04,421 INFO [Listener at localhost/45227] throttle.PressureAwareThroughputController(145): e4e58e8726a88cb9300f3431c6b54644#family2#compaction#203 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-22 10:56:04,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/cf6249d39f1c4f449fb9fd630eb3a043 2023-11-22 10:56:04,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/dd22659659b74ea1a972b1b4e61dd616 2023-11-22 10:56:04,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/66bb810d44b44bd78f96c406b29844e4 2023-11-22 10:56:04,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/d74c0d95b10b4068874b5b2bce84d740 2023-11-22 10:56:04,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/011bcfa703d44a7ca7a35e9362d78874 2023-11-22 10:56:04,427 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311220889b29696b84e23a01b858f7b9b0840_del 2023-11-22 10:56:04,427 INFO [Listener at localhost/45227] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311220889b29696b84e23a01b858f7b9b0840_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311220889b29696b84e23a01b858f7b9b0840_del 2023-11-22 10:56:04,437 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f870880cc84438eae5d87824de1b057 2023-11-22 10:56:04,438 DEBUG [Listener at localhost/45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/.tmp/family2/3f870880cc84438eae5d87824de1b057 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/3f870880cc84438eae5d87824de1b057 2023-11-22 10:56:04,440 INFO [Listener at localhost/45227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f870880cc84438eae5d87824de1b057 2023-11-22 10:56:04,441 INFO [Listener at localhost/45227] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e4e58e8726a88cb9300f3431c6b54644/family2 of e4e58e8726a88cb9300f3431c6b54644 into 3f870880cc84438eae5d87824de1b057(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-22 10:56:04,441 DEBUG [Listener at localhost/45227] regionserver.HRegion(2289): Compaction status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:56:04,445 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:56:04,448 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:56:04,451 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:56:04,452 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:56:04,457 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41509] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9C\xF9\xE0\xFE\xD3e^S9\x94\xC7\x12ZeG'"\x10\x96e\xC7#\xC7\x96\xF0\x0F\x83\x8D\xB1\xF5\xD6\x96\x9A\xCF*\x10({\xB9)\x9C\xDA\xFEJ\x84h\x19]\xB7J\x19\xEA2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-22 10:56:04,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-22 10:56:04,479 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-22 10:56:04,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:56:04,480 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700651164480 2023-11-22 10:56:04,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-22 10:56:04,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577] to archive 2023-11-22 10:56:04,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:04,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/ca9b07e6270249e393b95df693556000 2023-11-22 10:56:04,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/148b15c891fa4b558d9ec662b4e639c0 2023-11-22 10:56:04,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/b7071af5049b409083db0fa01f902d0b 2023-11-22 10:56:04,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/e4ea2c65a259420082676ffcb802620a 2023-11-22 10:56:04,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family2/a4e7e438fd374117b8efbb19ee0c8577 2023-11-22 10:56:04,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-22 10:56:04,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del 2023-11-22 10:56:04,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del 2023-11-22 10:56:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del 2023-11-22 10:56:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] zookeeper.ReadOnlyZKClient(139): Connect 0x12c29d67 to 127.0.0.1:57046 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-22 10:56:04,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a7bb26e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-22 10:56:04,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:05,083 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311229ca45adaa6874b17936192d74c2d5520 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311229ca45adaa6874b17936192d74c2d5520 2023-11-22 10:56:05,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:05,095 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-22 10:56:05,097 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-22 10:56:05,107 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-22 10:56:05,109 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-22 10:56:05,140 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231122/family1/59dbbeb3295b40f29cdf7c252a18f571 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-22 10:56:05,141 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231122/family1/59dbbeb3295b40f29cdf7c252a18f571}] 2023-11-22 10:56:05,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231122/family1/59dbbeb3295b40f29cdf7c252a18f571 for inclusion in 3957d4f92fe7cb11e03a78d65dbb7cee/family1 2023-11-22 10:56:05,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-22 10:56:05,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-22 10:56:05,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:56:05,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231122/family1/59dbbeb3295b40f29cdf7c252a18f571 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__hg4cf56cb4e08m4r8tq0fh0ghnbgi23rdt3aea2osbaikehcgj5uphb66eihb9i0/family1/59dbbeb3295b40f29cdf7c252a18f571 2023-11-22 10:56:05,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__hg4cf56cb4e08m4r8tq0fh0ghnbgi23rdt3aea2osbaikehcgj5uphb66eihb9i0/family1/59dbbeb3295b40f29cdf7c252a18f571 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/0ac5af5e1097402eafe094bc0ee77ca3_SeqId_28_ 2023-11-22 10:56:05,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__hg4cf56cb4e08m4r8tq0fh0ghnbgi23rdt3aea2osbaikehcgj5uphb66eihb9i0/family1/59dbbeb3295b40f29cdf7c252a18f571 into 3957d4f92fe7cb11e03a78d65dbb7cee/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/0ac5af5e1097402eafe094bc0ee77ca3_SeqId_28_ - updating store file list. 2023-11-22 10:56:05,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/0ac5af5e1097402eafe094bc0ee77ca3_SeqId_28_ into 3957d4f92fe7cb11e03a78d65dbb7cee/family1 2023-11-22 10:56:05,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__hg4cf56cb4e08m4r8tq0fh0ghnbgi23rdt3aea2osbaikehcgj5uphb66eihb9i0/family1/59dbbeb3295b40f29cdf7c252a18f571 into 3957d4f92fe7cb11e03a78d65dbb7cee/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/family1/0ac5af5e1097402eafe094bc0ee77ca3_SeqId_28_) 2023-11-22 10:56:05,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__hg4cf56cb4e08m4r8tq0fh0ghnbgi23rdt3aea2osbaikehcgj5uphb66eihb9i0/family1/59dbbeb3295b40f29cdf7c252a18f571 2023-11-22 10:56:05,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:05,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:05,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112257e13d2cf6ad456d852e8d996f206bed to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112257e13d2cf6ad456d852e8d996f206bed 2023-11-22 10:56:05,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f16bb7eb2aa44245a8b41e9868962ac1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f16bb7eb2aa44245a8b41e9868962ac1 2023-11-22 10:56:05,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f9f77ce56368453dbf2308833d2becda to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122f9f77ce56368453dbf2308833d2becda 2023-11-22 10:56:05,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122ff8f0033754c4c5babef2d357ef641dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231122ff8f0033754c4c5babef2d357ef641dd 2023-11-22 10:56:05,204 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-22 10:56:05,204 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231122' 2023-11-22 10:56:05,205 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:05,205 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:06,154 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231122100e7e08847040a5b57f7d19d781e422 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122100e7e08847040a5b57f7d19d781e422 2023-11-22 10:56:06,155 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:06,196 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231122/family1/cc15b5f9aa6c461daa211c2583526276 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-22 10:56:06,197 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231122/family1/cc15b5f9aa6c461daa211c2583526276}] 2023-11-22 10:56:06,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231122/family1/cc15b5f9aa6c461daa211c2583526276 for inclusion in bf02d69021be9e2afcbed635393a482f/family1 2023-11-22 10:56:06,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-22 10:56:06,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-22 10:56:06,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:56:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231122/family1/cc15b5f9aa6c461daa211c2583526276 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__ku43embrb3j4dheia23qi5q9p80t430icos9jn6jfisl500sb4jusrc3vieuo4f9/family1/cc15b5f9aa6c461daa211c2583526276 2023-11-22 10:56:06,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__ku43embrb3j4dheia23qi5q9p80t430icos9jn6jfisl500sb4jusrc3vieuo4f9/family1/cc15b5f9aa6c461daa211c2583526276 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/dd0111ef48784553a9f120a5036e8ea9_SeqId_28_ 2023-11-22 10:56:06,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__ku43embrb3j4dheia23qi5q9p80t430icos9jn6jfisl500sb4jusrc3vieuo4f9/family1/cc15b5f9aa6c461daa211c2583526276 into bf02d69021be9e2afcbed635393a482f/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/dd0111ef48784553a9f120a5036e8ea9_SeqId_28_ - updating store file list. 2023-11-22 10:56:06,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/dd0111ef48784553a9f120a5036e8ea9_SeqId_28_ into bf02d69021be9e2afcbed635393a482f/family1 2023-11-22 10:56:06,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__ku43embrb3j4dheia23qi5q9p80t430icos9jn6jfisl500sb4jusrc3vieuo4f9/family1/cc15b5f9aa6c461daa211c2583526276 into bf02d69021be9e2afcbed635393a482f/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/family1/dd0111ef48784553a9f120a5036e8ea9_SeqId_28_) 2023-11-22 10:56:06,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__ku43embrb3j4dheia23qi5q9p80t430icos9jn6jfisl500sb4jusrc3vieuo4f9/family1/cc15b5f9aa6c461daa211c2583526276 2023-11-22 10:56:06,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:06,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:06,261 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311221b5563f1b1cb45f5813670654b8b998f to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311221b5563f1b1cb45f5813670654b8b998f 2023-11-22 10:56:06,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122b60e75e5016547a89f8de3f3196c73d1 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122b60e75e5016547a89f8de3f3196c73d1 2023-11-22 10:56:06,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122e2e27be462ca496d87b407c9c15f803e to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122e2e27be462ca496d87b407c9c15f803e 2023-11-22 10:56:06,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122f0c8d13445c34a19bc494f89b32cf3dd to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122f0c8d13445c34a19bc494f89b32cf3dd 2023-11-22 10:56:06,264 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-22 10:56:06,264 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231122' 2023-11-22 10:56:06,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:06,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:06,823 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231122a37695294ad643978fac8aa42608b611 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231122a37695294ad643978fac8aa42608b611 2023-11-22 10:56:06,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:06,877 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231122/family1/f9f07a5c43644ace96db97a26699c9c2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-22 10:56:06,877 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644., hostname=jenkins-hbase4.apache.org,46051,1700650400831, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231122/family1/f9f07a5c43644ace96db97a26699c9c2}] 2023-11-22 10:56:06,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(763): Validating hfile at hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231122/family1/f9f07a5c43644ace96db97a26699c9c2 for inclusion in e4e58e8726a88cb9300f3431c6b54644/family1 2023-11-22 10:56:06,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-22 10:56:06,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(777): Region bounds: first= last=1 2023-11-22 10:56:06,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegion(2446): Flush status journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:56:06,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231122/family1/f9f07a5c43644ace96db97a26699c9c2 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__t3itg8ubv46c21ujaea2albnoi2t0k3ev343jhkpocnihippmvkdrbpr8o82bvgv/family1/f9f07a5c43644ace96db97a26699c9c2 2023-11-22 10:56:06,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__t3itg8ubv46c21ujaea2albnoi2t0k3ev343jhkpocnihippmvkdrbpr8o82bvgv/family1/f9f07a5c43644ace96db97a26699c9c2 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/e338b47b24e44587a5227da96066ce39_SeqId_28_ 2023-11-22 10:56:06,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(849): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__t3itg8ubv46c21ujaea2albnoi2t0k3ev343jhkpocnihippmvkdrbpr8o82bvgv/family1/f9f07a5c43644ace96db97a26699c9c2 into e4e58e8726a88cb9300f3431c6b54644/family1 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/e338b47b24e44587a5227da96066ce39_SeqId_28_ - updating store file list. 2023-11-22 10:56:06,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(882): Loaded HFile hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/e338b47b24e44587a5227da96066ce39_SeqId_28_ into e4e58e8726a88cb9300f3431c6b54644/family1 2023-11-22 10:56:06,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.HStore(855): Successfully loaded hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__t3itg8ubv46c21ujaea2albnoi2t0k3ev343jhkpocnihippmvkdrbpr8o82bvgv/family1/f9f07a5c43644ace96db97a26699c9c2 into e4e58e8726a88cb9300f3431c6b54644/family1 (new location: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/family1/e338b47b24e44587a5227da96066ce39_SeqId_28_) 2023-11-22 10:56:06,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46051] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/staging/jenkins__testMajorCompactionFromAdmin__t3itg8ubv46c21ujaea2albnoi2t0k3ev343jhkpocnihippmvkdrbpr8o82bvgv/family1/f9f07a5c43644ace96db97a26699c9c2 2023-11-22 10:56:06,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231122 table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:06,932 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:06,933 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311220c785ec9c1084f9599086c464a73d0f6 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311220c785ec9c1084f9599086c464a73d0f6 2023-11-22 10:56:06,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112217720f9037344b60a6afe8919663726c to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112217720f9037344b60a6afe8919663726c 2023-11-22 10:56:06,935 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311221e5f447f46454edaa48a2a03923bf6ec to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311221e5f447f46454edaa48a2a03923bf6ec 2023-11-22 10:56:06,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311222d0d513ac5864cc083f5bb187a73d4b5 to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311222d0d513ac5864cc083f5bb187a73d4b5 2023-11-22 10:56:06,936 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-22 10:56:06,936 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231122' 2023-11-22 10:56:06,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231122 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-22 10:56:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-22 10:56:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del] 2023-11-22 10:56:06,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:06,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231122cafe81bc86504e56bde04b63511f76f3_del 2023-11-22 10:56:06,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-22 10:56:06,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del] 2023-11-22 10:56:06,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:06,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231122a8497a4892bc4e898cee9d8a8574ea39_del 2023-11-22 10:56:06,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-22 10:56:06,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del] 2023-11-22 10:56:06,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(360): Archiving compacted files. 2023-11-22 10:56:06,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del to hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311223eb30c2835d942ff9ba7f54366bc8300_del 2023-11-22 10:56:06,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-22 10:56:06,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700650404601] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-22 10:56:06,942 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-22 10:56:06,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4640 sec 2023-11-22 10:56:06,957 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:56:06,959 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:56:06,961 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-22 10:56:06,962 DEBUG [Listener at localhost/45227] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-22 10:56:06,966 INFO [Listener at localhost/45227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-22 10:56:07,002 INFO [Listener at localhost/45227] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252 (was 263), OpenFileDescriptor=695 (was 679) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 172) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9886 (was 9906) 2023-11-22 10:56:07,002 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2131ff51 to 127.0.0.1:57046 2023-11-22 10:56:07,002 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:07,002 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-22 10:56:07,003 INFO [Listener at localhost/45227] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-22 10:56:07,003 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f95205 to 127.0.0.1:57046 2023-11-22 10:56:07,003 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:07,003 DEBUG [Listener at localhost/45227] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-22 10:56:07,003 DEBUG [Listener at localhost/45227] util.JVMClusterUtil(257): Found active master hash=1229242260, stopped=false 2023-11-22 10:56:07,003 INFO [Listener at localhost/45227] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:56:07,005 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-22 10:56:07,005 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-22 10:56:07,005 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:56:07,005 INFO [Listener at localhost/45227] procedure2.ProcedureExecutor(628): Stopping 2023-11-22 10:56:07,005 DEBUG [Listener at localhost/45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11bf69bc to 127.0.0.1:57046 2023-11-22 10:56:07,005 DEBUG [Listener at localhost/45227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:07,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-22 10:56:07,006 INFO [Listener at localhost/45227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46051,1700650400831' ***** 2023-11-22 10:56:07,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-22 10:56:07,006 INFO [Listener at localhost/45227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-22 10:56:07,006 INFO [RS:0;jenkins-hbase4:46051] regionserver.HeapMemoryManager(220): Stopping 2023-11-22 10:56:07,006 INFO [RS:0;jenkins-hbase4:46051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-22 10:56:07,006 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-22 10:56:07,006 INFO [RS:0;jenkins-hbase4:46051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 89e8dba924da56cd9cec1acc7b8d626b 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 3c07847601fb4586ffd51842a7561949 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for ab077d8a9706607380c45654591c8344 2023-11-22 10:56:07,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 89e8dba924da56cd9cec1acc7b8d626b, disabling compactions & flushes 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for bf02d69021be9e2afcbed635393a482f 2023-11-22 10:56:07,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 7d94bfc96b7868a4084ee7402665a512 2023-11-22 10:56:07,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 2d78f1fe8e03e176b334fe13f0b8aea2 2023-11-22 10:56:07,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. after waiting 0 ms 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 364f7661920cd9dfa5edfb250e4fabe6 2023-11-22 10:56:07,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for b15404ab0182f44b41d34545f368210a 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for aef988a75cfb01b10fb4b3de9e893b88 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 0ad6a67058299bbff56bafe728260442 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for d1127a5b857997a0630bd4d22b05e096 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 3957d4f92fe7cb11e03a78d65dbb7cee 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for dce3abe0feb2483bda35ed5e7c943d4a 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 43eaf7eb7374ce887acb8b9ce93e6ee1 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for c46ba14b3f8784c8b72ead76fe7a78cb 2023-11-22 10:56:07,007 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 4d460479f2059a1ac768b768200cf531 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for b29131cfb0e56bd85c37045435b6d18c 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for d76ac5550387fe39ca7acfefe93c1f17 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 3d37bf20b62569aeda6c03678e88a02e 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:56:07,008 DEBUG [RS:0;jenkins-hbase4:46051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76dca759 to 127.0.0.1:57046 2023-11-22 10:56:07,008 DEBUG [RS:0;jenkins-hbase4:46051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-22 10:56:07,008 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-22 10:56:07,009 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-22 10:56:07,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-22 10:56:07,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-22 10:56:07,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-22 10:56:07,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-22 10:56:07,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-22 10:56:07,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-22 10:56:07,009 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 0ad6a67058299bbff56bafe728260442, 1588230740, 2d78f1fe8e03e176b334fe13f0b8aea2, 364f7661920cd9dfa5edfb250e4fabe6, 3957d4f92fe7cb11e03a78d65dbb7cee, 3c07847601fb4586ffd51842a7561949, 3d37bf20b62569aeda6c03678e88a02e, 43eaf7eb7374ce887acb8b9ce93e6ee1, 4d460479f2059a1ac768b768200cf531, 7d94bfc96b7868a4084ee7402665a512, 89e8dba924da56cd9cec1acc7b8d626b, ab077d8a9706607380c45654591c8344, aef988a75cfb01b10fb4b3de9e893b88, b15404ab0182f44b41d34545f368210a, b29131cfb0e56bd85c37045435b6d18c, bf02d69021be9e2afcbed635393a482f, c46ba14b3f8784c8b72ead76fe7a78cb, d1127a5b857997a0630bd4d22b05e096, d76ac5550387fe39ca7acfefe93c1f17, dce3abe0feb2483bda35ed5e7c943d4a, e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:56:07,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/89e8dba924da56cd9cec1acc7b8d626b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-22 10:56:07,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:56:07,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 89e8dba924da56cd9cec1acc7b8d626b: 2023-11-22 10:56:07,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700650499148.89e8dba924da56cd9cec1acc7b8d626b. 2023-11-22 10:56:07,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c07847601fb4586ffd51842a7561949, disabling compactions & flushes 2023-11-22 10:56:07,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:56:07,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:56:07,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. after waiting 0 ms 2023-11-22 10:56:07,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:56:07,020 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-22 10:56:07,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/3c07847601fb4586ffd51842a7561949/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-22 10:56:07,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:56:07,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c07847601fb4586ffd51842a7561949: 2023-11-22 10:56:07,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700650459731.3c07847601fb4586ffd51842a7561949. 2023-11-22 10:56:07,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ab077d8a9706607380c45654591c8344, disabling compactions & flushes 2023-11-22 10:56:07,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:56:07,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:56:07,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. after waiting 0 ms 2023-11-22 10:56:07,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:56:07,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/ab077d8a9706607380c45654591c8344/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:56:07,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ab077d8a9706607380c45654591c8344: 2023-11-22 10:56:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700650522161.ab077d8a9706607380c45654591c8344. 2023-11-22 10:56:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf02d69021be9e2afcbed635393a482f, disabling compactions & flushes 2023-11-22 10:56:07,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. after waiting 0 ms 2023-11-22 10:56:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:07,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/bf02d69021be9e2afcbed635393a482f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf02d69021be9e2afcbed635393a482f: 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700650551142.bf02d69021be9e2afcbed635393a482f. 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d94bfc96b7868a4084ee7402665a512, disabling compactions & flushes 2023-11-22 10:56:07,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. after waiting 0 ms 2023-11-22 10:56:07,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:56:07,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithWeeklyPolicy/7d94bfc96b7868a4084ee7402665a512/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-22 10:56:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d94bfc96b7868a4084ee7402665a512: 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700650430620.7d94bfc96b7868a4084ee7402665a512. 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d78f1fe8e03e176b334fe13f0b8aea2, disabling compactions & flushes 2023-11-22 10:56:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. after waiting 0 ms 2023-11-22 10:56:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:56:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2d78f1fe8e03e176b334fe13f0b8aea2 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-22 10:56:07,072 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-22 10:56:07,152 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-22 10:56:07,152 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-22 10:56:07,210 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 0ad6a67058299bbff56bafe728260442, 1588230740, 2d78f1fe8e03e176b334fe13f0b8aea2, 364f7661920cd9dfa5edfb250e4fabe6, 3957d4f92fe7cb11e03a78d65dbb7cee, 3d37bf20b62569aeda6c03678e88a02e, 43eaf7eb7374ce887acb8b9ce93e6ee1, 4d460479f2059a1ac768b768200cf531, aef988a75cfb01b10fb4b3de9e893b88, b15404ab0182f44b41d34545f368210a, b29131cfb0e56bd85c37045435b6d18c, c46ba14b3f8784c8b72ead76fe7a78cb, d1127a5b857997a0630bd4d22b05e096, d76ac5550387fe39ca7acfefe93c1f17, dce3abe0feb2483bda35ed5e7c943d4a, e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:56:07,410 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 0ad6a67058299bbff56bafe728260442, 1588230740, 2d78f1fe8e03e176b334fe13f0b8aea2, 364f7661920cd9dfa5edfb250e4fabe6, 3957d4f92fe7cb11e03a78d65dbb7cee, 3d37bf20b62569aeda6c03678e88a02e, 43eaf7eb7374ce887acb8b9ce93e6ee1, 4d460479f2059a1ac768b768200cf531, aef988a75cfb01b10fb4b3de9e893b88, b15404ab0182f44b41d34545f368210a, b29131cfb0e56bd85c37045435b6d18c, c46ba14b3f8784c8b72ead76fe7a78cb, d1127a5b857997a0630bd4d22b05e096, d76ac5550387fe39ca7acfefe93c1f17, dce3abe0feb2483bda35ed5e7c943d4a, e4e58e8726a88cb9300f3431c6b54644 2023-11-22 10:56:07,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/info/db288219e1f7434fbec7edb64211e1ed 2023-11-22 10:56:07,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db288219e1f7434fbec7edb64211e1ed 2023-11-22 10:56:07,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/.tmp/info/ae54937eeb344b51bba757ccb4e391a5 2023-11-22 10:56:07,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/.tmp/info/ae54937eeb344b51bba757ccb4e391a5 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/info/ae54937eeb344b51bba757ccb4e391a5 2023-11-22 10:56:07,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/info/ae54937eeb344b51bba757ccb4e391a5, entries=3, sequenceid=7, filesize=4.8 K 2023-11-22 10:56:07,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 2d78f1fe8e03e176b334fe13f0b8aea2 in 415ms, sequenceid=7, compaction requested=false 2023-11-22 10:56:07,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/namespace/2d78f1fe8e03e176b334fe13f0b8aea2/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-22 10:56:07,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:56:07,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d78f1fe8e03e176b334fe13f0b8aea2: 2023-11-22 10:56:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700650403185.2d78f1fe8e03e176b334fe13f0b8aea2. 2023-11-22 10:56:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 364f7661920cd9dfa5edfb250e4fabe6, disabling compactions & flushes 2023-11-22 10:56:07,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:56:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:56:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. after waiting 0 ms 2023-11-22 10:56:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:56:07,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/364f7661920cd9dfa5edfb250e4fabe6/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-22 10:56:07,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 364f7661920cd9dfa5edfb250e4fabe6: 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700650442030.364f7661920cd9dfa5edfb250e4fabe6. 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b15404ab0182f44b41d34545f368210a, disabling compactions & flushes 2023-11-22 10:56:07,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. after waiting 0 ms 2023-11-22 10:56:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:56:07,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b15404ab0182f44b41d34545f368210a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-22 10:56:07,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:56:07,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b15404ab0182f44b41d34545f368210a: 2023-11-22 10:56:07,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700650476760.b15404ab0182f44b41d34545f368210a. 2023-11-22 10:56:07,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aef988a75cfb01b10fb4b3de9e893b88, disabling compactions & flushes 2023-11-22 10:56:07,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:56:07,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:56:07,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. after waiting 0 ms 2023-11-22 10:56:07,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:56:07,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/aef988a75cfb01b10fb4b3de9e893b88/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aef988a75cfb01b10fb4b3de9e893b88: 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700650522161.aef988a75cfb01b10fb4b3de9e893b88. 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ad6a67058299bbff56bafe728260442, disabling compactions & flushes 2023-11-22 10:56:07,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. after waiting 0 ms 2023-11-22 10:56:07,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:56:07,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0ad6a67058299bbff56bafe728260442/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-22 10:56:07,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ad6a67058299bbff56bafe728260442: 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700650404812.0ad6a67058299bbff56bafe728260442. 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1127a5b857997a0630bd4d22b05e096, disabling compactions & flushes 2023-11-22 10:56:07,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. after waiting 0 ms 2023-11-22 10:56:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:56:07,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithMonthlyPolicy/d1127a5b857997a0630bd4d22b05e096/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-22 10:56:07,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1127a5b857997a0630bd4d22b05e096: 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700650415795.d1127a5b857997a0630bd4d22b05e096. 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3957d4f92fe7cb11e03a78d65dbb7cee, disabling compactions & flushes 2023-11-22 10:56:07,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. after waiting 0 ms 2023-11-22 10:56:07,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:07,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/3957d4f92fe7cb11e03a78d65dbb7cee/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3957d4f92fe7cb11e03a78d65dbb7cee: 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700650551142.3957d4f92fe7cb11e03a78d65dbb7cee. 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4e58e8726a88cb9300f3431c6b54644, disabling compactions & flushes 2023-11-22 10:56:07,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. after waiting 0 ms 2023-11-22 10:56:07,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:07,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionFromAdmin/e4e58e8726a88cb9300f3431c6b54644/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4e58e8726a88cb9300f3431c6b54644: 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700650551142.e4e58e8726a88cb9300f3431c6b54644. 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dce3abe0feb2483bda35ed5e7c943d4a, disabling compactions & flushes 2023-11-22 10:56:07,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. after waiting 0 ms 2023-11-22 10:56:07,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMajorCompactionWithWeeklyPolicy/dce3abe0feb2483bda35ed5e7c943d4a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-22 10:56:07,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dce3abe0feb2483bda35ed5e7c943d4a: 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700650447038.dce3abe0feb2483bda35ed5e7c943d4a. 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 43eaf7eb7374ce887acb8b9ce93e6ee1, disabling compactions & flushes 2023-11-22 10:56:07,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. after waiting 0 ms 2023-11-22 10:56:07,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:56:07,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/43eaf7eb7374ce887acb8b9ce93e6ee1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-22 10:56:07,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:56:07,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 43eaf7eb7374ce887acb8b9ce93e6ee1: 2023-11-22 10:56:07,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700650442030.43eaf7eb7374ce887acb8b9ce93e6ee1. 2023-11-22 10:56:07,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c46ba14b3f8784c8b72ead76fe7a78cb, disabling compactions & flushes 2023-11-22 10:56:07,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:56:07,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:56:07,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. after waiting 0 ms 2023-11-22 10:56:07,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/c46ba14b3f8784c8b72ead76fe7a78cb/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-22 10:56:07,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c46ba14b3f8784c8b72ead76fe7a78cb: 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700650499148.c46ba14b3f8784c8b72ead76fe7a78cb. 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d460479f2059a1ac768b768200cf531, disabling compactions & flushes 2023-11-22 10:56:07,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. after waiting 0 ms 2023-11-22 10:56:07,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:56:07,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testScannerOnBulkLoadRefHFiles/4d460479f2059a1ac768b768200cf531/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-22 10:56:07,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d460479f2059a1ac768b768200cf531: 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700650442030.4d460479f2059a1ac768b768200cf531. 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b29131cfb0e56bd85c37045435b6d18c, disabling compactions & flushes 2023-11-22 10:56:07,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. after waiting 0 ms 2023-11-22 10:56:07,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:56:07,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testMinorCompactionWithMonthlyPolicy/b29131cfb0e56bd85c37045435b6d18c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-22 10:56:07,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:56:07,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b29131cfb0e56bd85c37045435b6d18c: 2023-11-22 10:56:07,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700650539727.b29131cfb0e56bd85c37045435b6d18c. 2023-11-22 10:56:07,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d76ac5550387fe39ca7acfefe93c1f17, disabling compactions & flushes 2023-11-22 10:56:07,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:56:07,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:56:07,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. after waiting 0 ms 2023-11-22 10:56:07,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:56:07,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/default/testCompactionWithHFileLink/d76ac5550387fe39ca7acfefe93c1f17/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-22 10:56:07,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:56:07,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d76ac5550387fe39ca7acfefe93c1f17: 2023-11-22 10:56:07,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700650499148.d76ac5550387fe39ca7acfefe93c1f17. 2023-11-22 10:56:07,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3d37bf20b62569aeda6c03678e88a02e, disabling compactions & flushes 2023-11-22 10:56:07,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:56:07,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:56:07,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. after waiting 0 ms 2023-11-22 10:56:07,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:56:07,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/ns/testMinorCompaction/3d37bf20b62569aeda6c03678e88a02e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-22 10:56:07,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:56:07,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3d37bf20b62569aeda6c03678e88a02e: 2023-11-22 10:56:07,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700650522161.3d37bf20b62569aeda6c03678e88a02e. 2023-11-22 10:56:07,611 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-22 10:56:07,811 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-22 10:56:07,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/rep_barrier/60ba8916b61a4b118506c06494d3cb1c 2023-11-22 10:56:07,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60ba8916b61a4b118506c06494d3cb1c 2023-11-22 10:56:08,011 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-22 10:56:08,011 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-22 10:56:08,011 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-22 10:56:08,211 DEBUG [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-22 10:56:08,246 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/table/029af77bbb7c49ebb17c06e57d47bc18 2023-11-22 10:56:08,250 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 029af77bbb7c49ebb17c06e57d47bc18 2023-11-22 10:56:08,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/info/db288219e1f7434fbec7edb64211e1ed as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/info/db288219e1f7434fbec7edb64211e1ed 2023-11-22 10:56:08,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db288219e1f7434fbec7edb64211e1ed 2023-11-22 10:56:08,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/info/db288219e1f7434fbec7edb64211e1ed, entries=226, sequenceid=130, filesize=37.9 K 2023-11-22 10:56:08,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/rep_barrier/60ba8916b61a4b118506c06494d3cb1c as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/rep_barrier/60ba8916b61a4b118506c06494d3cb1c 2023-11-22 10:56:08,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60ba8916b61a4b118506c06494d3cb1c 2023-11-22 10:56:08,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/rep_barrier/60ba8916b61a4b118506c06494d3cb1c, entries=1, sequenceid=130, filesize=5.0 K 2023-11-22 10:56:08,261 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/.tmp/table/029af77bbb7c49ebb17c06e57d47bc18 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/table/029af77bbb7c49ebb17c06e57d47bc18 2023-11-22 10:56:08,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 029af77bbb7c49ebb17c06e57d47bc18 2023-11-22 10:56:08,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/table/029af77bbb7c49ebb17c06e57d47bc18, entries=27, sequenceid=130, filesize=6.6 K 2023-11-22 10:56:08,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1257ms, sequenceid=130, compaction requested=false 2023-11-22 10:56:08,269 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-22 10:56:08,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-22 10:56:08,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-22 10:56:08,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-22 10:56:08,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-22 10:56:08,412 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46051,1700650400831; all regions closed. 2023-11-22 10:56:08,419 DEBUG [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/oldWALs 2023-11-22 10:56:08,419 INFO [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46051%2C1700650400831.meta:.meta(num 1700650402916) 2023-11-22 10:56:08,423 DEBUG [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/oldWALs 2023-11-22 10:56:08,423 INFO [RS:0;jenkins-hbase4:46051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46051%2C1700650400831:(num 1700650402311) 2023-11-22 10:56:08,423 DEBUG [RS:0;jenkins-hbase4:46051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:08,423 INFO [RS:0;jenkins-hbase4:46051] regionserver.LeaseManager(133): Closed leases 2023-11-22 10:56:08,423 INFO [RS:0;jenkins-hbase4:46051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-22 10:56:08,424 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-22 10:56:08,425 INFO [RS:0;jenkins-hbase4:46051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46051 2023-11-22 10:56:08,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46051,1700650400831 2023-11-22 10:56:08,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-22 10:56:08,432 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-22 10:56:08,434 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46051,1700650400831] 2023-11-22 10:56:08,434 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46051,1700650400831; numProcessing=1 2023-11-22 10:56:08,435 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46051,1700650400831 already deleted, retry=false 2023-11-22 10:56:08,435 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46051,1700650400831 expired; onlineServers=0 2023-11-22 10:56:08,435 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41509,1700650399619' ***** 2023-11-22 10:56:08,435 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-22 10:56:08,436 DEBUG [M:0;jenkins-hbase4:41509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@879b5af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-22 10:56:08,436 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41509,1700650399619 2023-11-22 10:56:08,436 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41509,1700650399619; all regions closed. 2023-11-22 10:56:08,436 DEBUG [M:0;jenkins-hbase4:41509] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-22 10:56:08,436 DEBUG [M:0;jenkins-hbase4:41509] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-22 10:56:08,436 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-22 10:56:08,436 DEBUG [M:0;jenkins-hbase4:41509] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-22 10:56:08,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700650402019] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700650402019,5,FailOnTimeoutGroup] 2023-11-22 10:56:08,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700650402020] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700650402020,5,FailOnTimeoutGroup] 2023-11-22 10:56:08,436 INFO [M:0;jenkins-hbase4:41509] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-22 10:56:08,436 INFO [M:0;jenkins-hbase4:41509] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-22 10:56:08,436 INFO [M:0;jenkins-hbase4:41509] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-22 10:56:08,437 DEBUG [M:0;jenkins-hbase4:41509] master.HMaster(1512): Stopping service threads 2023-11-22 10:56:08,437 INFO [M:0;jenkins-hbase4:41509] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-22 10:56:08,437 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-22 10:56:08,437 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-22 10:56:08,437 ERROR [M:0;jenkins-hbase4:41509] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-22 10:56:08,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-22 10:56:08,438 INFO [M:0;jenkins-hbase4:41509] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-22 10:56:08,438 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-22 10:56:08,438 DEBUG [M:0;jenkins-hbase4:41509] zookeeper.ZKUtil(398): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-22 10:56:08,438 WARN [M:0;jenkins-hbase4:41509] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-22 10:56:08,438 INFO [M:0;jenkins-hbase4:41509] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-22 10:56:08,438 INFO [M:0;jenkins-hbase4:41509] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-22 10:56:08,439 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-22 10:56:08,439 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:56:08,439 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:56:08,439 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-22 10:56:08,439 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:56:08,439 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.74 KB heapSize=598.51 KB 2023-11-22 10:56:08,447 INFO [M:0;jenkins-hbase4:41509] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.74 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/886a48b48936407ba74200ca6cbb66e3 2023-11-22 10:56:08,449 INFO [M:0;jenkins-hbase4:41509] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 886a48b48936407ba74200ca6cbb66e3 2023-11-22 10:56:08,450 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/886a48b48936407ba74200ca6cbb66e3 as hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/886a48b48936407ba74200ca6cbb66e3 2023-11-22 10:56:08,453 INFO [M:0;jenkins-hbase4:41509] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 886a48b48936407ba74200ca6cbb66e3 2023-11-22 10:56:08,453 INFO [M:0;jenkins-hbase4:41509] regionserver.HStore(1080): Added hdfs://localhost:42673/user/jenkins/test-data/4408ff20-6dcd-63a8-3b25-f865a6f16e8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/886a48b48936407ba74200ca6cbb66e3, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-22 10:56:08,454 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegion(2948): Finished flush of dataSize ~512.74 KB/525042, heapSize ~598.49 KB/612856, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=1006, compaction requested=false 2023-11-22 10:56:08,454 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-22 10:56:08,454 DEBUG [M:0;jenkins-hbase4:41509] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-22 10:56:08,457 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-22 10:56:08,457 INFO [M:0;jenkins-hbase4:41509] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-22 10:56:08,457 INFO [M:0;jenkins-hbase4:41509] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41509 2023-11-22 10:56:08,459 DEBUG [M:0;jenkins-hbase4:41509] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41509,1700650399619 already deleted, retry=false 2023-11-22 10:56:08,534 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-22 10:56:08,534 INFO [RS:0;jenkins-hbase4:46051] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46051,1700650400831; zookeeper connection closed. 2023-11-22 10:56:08,534 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): regionserver:46051-0x10014b998340001, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-22 10:56:08,534 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a1c3a5d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a1c3a5d 2023-11-22 10:56:08,535 INFO [Listener at localhost/45227] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-22 10:56:08,561 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-22 10:56:08,561 INFO [M:0;jenkins-hbase4:41509] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41509,1700650399619; zookeeper connection closed. 2023-11-22 10:56:08,561 DEBUG [Listener at localhost/45227-EventThread] zookeeper.ZKWatcher(600): master:41509-0x10014b998340000, quorum=127.0.0.1:57046, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-22 10:56:08,563 WARN [Listener at localhost/45227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-22 10:56:08,568 INFO [Listener at localhost/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-22 10:56:08,675 WARN [BP-1707977194-172.31.14.131-1700650396166 heartbeating to localhost/127.0.0.1:42673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-22 10:56:08,675 WARN [BP-1707977194-172.31.14.131-1700650396166 heartbeating to localhost/127.0.0.1:42673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1707977194-172.31.14.131-1700650396166 (Datanode Uuid 576887cb-ebf2-41c9-9de2-6bb11603a0c6) service to localhost/127.0.0.1:42673 2023-11-22 10:56:08,678 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/dfs/data/data1/current/BP-1707977194-172.31.14.131-1700650396166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-22 10:56:08,679 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f93b0a0a-7578-5416-7656-d3df07352e56/cluster_c03763f5-0146-fc32-27f1-aacae6790dbf/dfs/data/data2/current/BP-1707977194-172.31.14.131-1700650396166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-22 10:56:08,705 INFO [Listener at localhost/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-22 10:56:08,847 INFO [Listener at localhost/45227] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-22 10:56:08,927 INFO [Listener at localhost/45227] hbase.HBaseTestingUtility(1293): Minicluster is down